-- Logs begin at Thu 2022-06-16 17:00:35 UTC, end at Thu 2022-06-16 18:31:38 UTC. -- Jun 16 17:57:26.188238 dv-cinder-837543-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 17:57:26.197971 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 17:57:26.200045 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 17:57:26 2022] *** Jun 16 17:57:26.200045 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 17:57:26.200045 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 17:57:26.200045 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: nodename: dv-cinder-837543-4-iscsi Jun 16 17:57:26.200045 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: machine: x86_64 Jun 16 17:57:26.200045 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: clock source: unix Jun 16 17:57:26.200045 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: pcre jit disabled Jun 16 17:57:26.200045 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: detected number of CPU cores: 4 Jun 16 17:57:26.200045 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: current working directory: / Jun 16 17:57:26.200045 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: detected binary path: /usr/bin/uwsgi-core Jun 16 17:57:26.200776 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: your processes number limit is 47680 Jun 16 17:57:26.200776 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: your memory page size is 4096 bytes Jun 16 17:57:26.200776 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: detected max file descriptor number: 2048 Jun 16 17:57:26.200776 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: lock engine: pthread robust mutexes Jun 16 17:57:26.200776 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: thunder lock: enabled Jun 16 17:57:26.200776 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 17:57:26.200776 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 17:57:26.244438 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: Python main interpreter initialized at 0x55c8e6cf99c0 Jun 16 17:57:26.244438 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: python threads support enabled Jun 16 17:57:26.244438 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: your server socket listen backlog is limited to 100 connections Jun 16 17:57:26.244438 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: your mercy for graceful operations on workers is 90 seconds Jun 16 17:57:26.244869 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 17:57:26.244869 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: *** Operational MODE: preforking *** Jun 16 17:57:26.245162 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: *** uWSGI is running in multiple interpreter mode *** Jun 16 17:57:26.245162 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: spawned uWSGI master process (pid: 103782) Jun 16 17:57:26.245362 dv-cinder-837543-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 17:57:26.246518 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: spawned uWSGI worker 1 (pid: 103783, cores: 1) Jun 16 17:57:26.246518 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: spawned uWSGI worker 2 (pid: 103784, cores: 1) Jun 16 17:57:26.246518 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 17:57:26.911479 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:57:26.921690 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 17:57:28.092838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:57:28.092838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: from cryptography.utils import int_from_bytes Jun 16 17:57:28.093533 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:57:28.093533 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: from cryptography.utils import int_from_bytes Jun 16 17:57:28.110503 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:57:28.110503 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: from cryptography.utils import int_from_bytes Jun 16 17:57:28.110968 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 17:57:28.110968 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: from cryptography.utils import int_from_bytes Jun 16 17:57:30.663599 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:57:30.664144 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:57:30.664276 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:57:30.664604 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 17:57:30.665012 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:57:30.665115 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 17:57:30.665199 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:57:30.665279 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.665356 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 17:57:30.665565 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.665722 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 17:57:30.665885 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.665982 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 17:57:30.666202 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.666357 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.666531 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.666740 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.666843 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.667065 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.667150 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.667412 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.667516 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.667747 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.667833 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.668025 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.668124 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.668338 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.668431 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.668660 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-4-iscsi {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.668747 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.668996 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.669089 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.669236 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.669330 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.669553 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.669645 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.669876 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-4-iscsi {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.669975 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.670175 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.670266 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.670490 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.670581 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.670790 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.670884 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.671104 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.671288 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.671448 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.671739 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.671909 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.672056 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.672203 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.672340 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.672701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.672883 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.672968 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.673094 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.673185 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.673286 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.673427 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.673563 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.673762 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.673908 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.674074 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.674204 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.674385 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.674555 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.674705 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.674832 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-4-iscsi {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.675014 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.675149 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.675337 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.675484 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.675668 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.675799 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.676062 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-4-iscsi {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.676208 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.676377 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.676520 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.676689 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.676811 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.677002 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.677128 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.677981 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.678539 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.678645 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.678727 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.678727 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.678929 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.679022 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.679103 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.679346 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.679457 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.679685 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.679772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.679986 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.680085 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.680294 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.680389 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.680601 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.680695 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.680918 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.681013 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.681218 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.681329 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.681517 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.681619 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.681768 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.681855 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.682074 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.682171 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.682392 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.682494 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.682710 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.682802 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.682960 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.683044 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.683265 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.683354 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.683541 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.683676 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.683859 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.683963 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.684178 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.684278 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.684468 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.684566 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.684720 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.684835 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.685039 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.685136 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.685358 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.685457 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.685659 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.685769 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.685964 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.686068 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.686267 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.686364 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.686572 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.686678 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.686880 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.686988 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.687189 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.687286 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.687521 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.687617 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.687829 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.687926 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.688142 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.688237 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.688460 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.688559 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.688777 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.688864 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.689082 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.689171 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.689402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.689500 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.689719 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.689807 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.690024 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.690111 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.690332 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.690427 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.690648 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.690743 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.690957 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.691058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.691261 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.691387 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.691593 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.691694 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.691909 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.692007 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.692216 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.692309 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.692524 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.692612 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.692769 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.692864 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.693125 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.693218 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.693579 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.693676 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.693898 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.694005 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.694198 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.694299 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.694504 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.694598 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.694808 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.694904 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.695115 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.695213 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.695441 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.695535 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.695749 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.695839 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.696055 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.696142 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.696357 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.696445 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.696659 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.696754 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.696961 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.697058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.697266 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.697354 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.697570 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.697658 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.697876 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.697968 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.698180 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.698266 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.698498 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.698586 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.698806 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.698977 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.699110 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.699289 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.699438 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.699638 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.699739 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.699958 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.700047 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.700269 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.700439 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.700633 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.700813 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.700953 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.701259 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.701360 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.701565 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.701725 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.701882 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.701978 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.702187 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.702276 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.702492 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.702589 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.702806 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.702895 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.703105 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.703205 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.703432 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.703559 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.703768 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.703863 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.704058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.704169 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.704362 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.704454 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.704663 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.704748 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.704968 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.705061 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.705265 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.705351 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.705569 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.705655 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.705873 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.705971 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.706174 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.706266 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.706470 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.706562 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.706772 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.706858 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.707079 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.707170 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.707401 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.707502 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.707711 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.707821 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.708014 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.708109 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.708314 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.708406 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.708683 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.708826 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.709053 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.709452 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.709543 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.709629 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.709716 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.709796 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.709982 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.710077 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.710314 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.710409 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 17:57:30.710635 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.710721 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.710948 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.711035 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.711264 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.711387 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.711615 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.711701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.711928 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.712029 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.712239 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.712333 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.712549 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.712636 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.712866 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.712951 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.713183 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.713269 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.713510 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.713594 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.713823 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.713923 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.714134 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.714243 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.714448 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.714535 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.714755 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.714840 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.715077 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.715176 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.715423 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.715514 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.715746 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.715843 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.716053 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.716139 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.716372 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.716466 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.716686 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.716772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.717010 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.717100 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.717330 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.717415 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.717650 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.717743 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.717961 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.718053 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.718269 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.718361 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.718579 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.718664 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.718898 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.718986 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.719233 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.719327 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.719570 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.719672 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.719885 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.719970 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.720194 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.720278 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.720505 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.720598 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.720811 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.720904 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.721122 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.721216 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.721434 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.721530 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.721756 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.721841 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.722066 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.722153 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.722378 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.722539 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.722687 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.722771 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.722997 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.723087 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.723305 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.723421 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.723641 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.723729 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.723951 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.724039 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.724787 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.725300 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.725413 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.725496 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.725574 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.725651 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.725737 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.725816 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.725979 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.726114 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.726299 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.726430 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.726623 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.726739 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.726928 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.727049 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.727258 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.727352 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.727585 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.727672 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.727896 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.727982 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.728206 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.728303 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.728516 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.728609 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.728820 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.728914 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.729132 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.729227 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.729440 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.729533 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.729743 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.729837 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.730064 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.730160 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.730375 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.730461 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.730678 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.730766 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.730991 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.731084 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.731306 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.731499 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.731619 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.731716 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.731929 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.732060 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.732239 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.732324 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.732547 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.732632 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.732859 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.732955 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.733165 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.733250 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.733473 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.733565 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.733785 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.733929 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.734097 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.734184 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.734410 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.734507 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.734725 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.734812 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.735037 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.735123 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.735381 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.735519 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.735701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.735794 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.736015 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.736099 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.736320 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.736414 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.736632 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.736724 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.736936 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.737021 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.737241 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.737389 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.737544 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.737675 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.737852 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.737999 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.738139 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.738275 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.738443 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.738574 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.738745 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.738875 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.739049 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.739190 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.739352 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.739519 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.739687 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.739832 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.741008 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.741147 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.741293 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.741429 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.741569 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.741703 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.741844 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.741976 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.741976 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.742233 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.742233 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.742497 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.742497 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.742773 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.742914 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.743046 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.743180 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.743319 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.743477 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.743622 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.743756 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.743899 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.744033 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.744190 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.744320 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.744451 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.744534 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.744612 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.744828 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.744924 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.745137 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.745229 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.745456 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.745542 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.745766 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.745859 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.746076 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.746160 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.746385 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.746470 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.746698 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.746783 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.747006 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.747090 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.747325 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.747435 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.747664 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.747759 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.747979 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.748063 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.748291 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.748375 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.748618 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.748706 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.748937 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.749023 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.749254 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.749337 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.749559 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.749644 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.749870 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.749961 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.750181 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.750274 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.750490 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.750576 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.750801 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.750886 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.751111 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.751206 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.751457 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.751547 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.751769 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.751854 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.752079 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.752242 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.752388 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.752472 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.752699 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.752790 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.753005 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.753098 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.753322 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.753408 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.753623 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.753715 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.753934 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.754029 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.754244 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.754329 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.754572 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.754657 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.754880 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.754966 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.755192 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.755277 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.755601 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.756118 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.756118 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.756287 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.756287 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.756429 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.756604 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.756691 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.756922 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.757010 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.757239 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.757324 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.757551 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.757636 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.757862 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.757956 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.758170 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.758263 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.758481 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.758575 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.758785 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.758870 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.759093 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.759178 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.759422 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.759523 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.759729 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.759815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.760032 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.760117 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.760341 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.760435 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.760648 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.760733 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.760961 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.761045 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.761271 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.761363 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.761579 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.761665 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.761881 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.761966 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.762440 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.762536 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.762759 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.762853 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.763070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.763156 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.763387 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.763477 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.763701 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.763798 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.764004 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.764091 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.764320 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.764406 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.764641 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.764740 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.764945 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.765031 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.765251 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.765336 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.765559 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.765652 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.765867 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.765966 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.766178 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.766263 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.766491 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.766576 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.766799 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.766894 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.767115 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.767199 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.767458 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.767549 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.767771 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.767869 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.768080 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.768166 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.768390 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.768477 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.768703 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.768796 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.769011 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.769097 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.769331 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.769415 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.769640 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.769727 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.769953 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.770037 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.770261 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.770345 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.770564 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.770651 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.770873 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.770958 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.771224 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.771764 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.771764 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.771936 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.772015 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.772159 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.772314 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.772498 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.772633 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.772779 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.772954 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.773100 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.773276 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.773634 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.773723 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.773970 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.774063 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.774290 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.774375 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.774613 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.774779 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.774936 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.775037 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.775245 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.775330 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.775582 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.775682 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.775892 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.775986 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.776207 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.776301 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.776517 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.776612 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.776824 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.776913 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.777130 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.777215 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.777440 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.777527 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.777744 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.777831 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.778049 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.778136 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.778350 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.778434 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.778653 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.778739 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.778963 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.779048 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.779265 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.779349 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.779594 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.779680 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.779894 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.779978 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.780197 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.780290 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.780510 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.780595 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.780813 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.780896 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.781115 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.781207 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.781418 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.781502 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.781740 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.781826 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.782048 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.782141 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.782351 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.782437 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.782656 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.782751 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.782961 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.783056 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.783305 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.783423 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.783634 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.783730 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.783958 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.784046 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.784262 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.784349 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.784567 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.784652 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.784869 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.784955 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.785177 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.785262 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.785490 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.785575 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.785790 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.785877 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.786095 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.786180 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.786402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.786488 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.787208 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.787711 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.787711 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.787888 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.787971 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.788063 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.788142 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.788217 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.788432 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.788526 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.788740 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.788836 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.789049 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.789141 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.789351 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.789437 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.789652 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.789746 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.789958 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.790043 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.790263 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.790349 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.790565 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.790659 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.790869 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.790955 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.791169 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.791253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.791501 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.791602 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.791804 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.791890 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.792106 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.792198 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.792407 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.792493 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.792711 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.792796 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.793016 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.793100 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.793319 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.793405 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.793623 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.793709 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.793927 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.794020 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.794227 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.794320 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.794529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.794614 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.794832 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.794981 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.795130 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.795223 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.795458 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.795546 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.795769 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.795872 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.796074 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.796160 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.796384 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.796478 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.796684 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.796781 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.796987 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.797073 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.797289 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.797373 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.797591 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.797725 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.797893 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.797984 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.798198 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.798284 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.798494 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.798581 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.798794 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.798880 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.799094 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.799179 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.799415 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.799516 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.799718 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.799803 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.800019 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.800111 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.800322 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.800411 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.800622 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.800717 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.800924 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.801017 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.801222 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.801308 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.801540 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.801625 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.801851 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.801948 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.802155 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.802241 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.803050 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.803609 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.803715 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.803794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.803869 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.803949 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.804015 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.804166 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.804343 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.804515 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.804628 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.804877 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.805059 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.805213 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.805360 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.805520 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.805616 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.805776 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.806078 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.806167 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.806380 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.806648 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.806743 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.806994 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.807217 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.807303 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.807612 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.807701 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.807941 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.808149 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.808280 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.808553 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.808722 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.808860 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.809173 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.809308 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.809477 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.809784 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.809882 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.810093 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.810291 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.810455 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.810636 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.810794 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.810959 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.811098 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.811280 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.811476 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.811625 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.811753 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.811906 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.812215 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.812310 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.812573 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.812820 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.812918 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.813191 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.813340 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.813501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.813642 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.813786 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.813932 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.814099 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.814242 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.814405 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.814547 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.814715 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.814874 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.815004 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.815149 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.815454 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.815545 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.815768 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.815856 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.816086 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.816182 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.816392 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.816478 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.816703 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.816790 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.817012 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.817098 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.817325 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.817411 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.817636 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.817723 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.817955 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.818075 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.818633 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.818724 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.818820 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.818902 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.818980 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.819065 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.819257 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.819425 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.819600 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.819708 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.819995 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.820097 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.820307 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.820412 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.820632 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.820718 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.820937 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.821024 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.821241 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.821337 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.821545 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.821631 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.821861 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.821962 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.822163 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.822257 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.822547 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.822638 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.822859 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.823075 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.823280 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.823433 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.823623 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.823730 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.823940 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.824152 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.824258 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.824468 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.824555 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.824782 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.824868 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.825110 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.825219 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.825433 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.825520 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.825745 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.825834 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.826056 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.826168 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.826362 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.826448 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.826670 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.826802 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.826980 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.827075 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.827305 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.827420 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.827642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.827735 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.827960 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.828092 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.828266 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.828379 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.828589 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.828748 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.828910 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.829062 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.829224 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.829382 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.829545 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.829708 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.829957 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.830044 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.830280 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.830367 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.830591 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.830684 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.830912 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.830998 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.831229 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.831324 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.831557 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.831650 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.831864 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.831959 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.832176 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.832264 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.832482 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.832568 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.832788 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.832882 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.833110 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.833196 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.833415 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.833501 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.833774 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.834312 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.834405 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.834485 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.834571 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.834649 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.834821 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.834917 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.835127 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.835221 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.835477 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.835600 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.835791 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.835896 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.836117 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.836226 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.836433 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.836532 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.836823 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.836929 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.837062 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.837165 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.837368 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.837462 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.837692 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.837780 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.837999 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.838093 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.838303 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.838441 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.838591 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.838727 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.838898 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.839034 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.839212 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.839355 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.839556 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.839698 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.839877 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.840025 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.840181 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.840329 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.840505 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.840642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.840821 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.840958 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.841146 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.841294 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.841469 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.841613 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.841778 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.841927 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.842092 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.842234 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.842402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.842537 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.842704 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.842838 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.843007 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.843149 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.843313 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.843496 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.843632 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.843773 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.843927 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.844063 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.844219 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.844354 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.844526 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.844668 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.844829 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.844965 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.845130 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.845267 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.845432 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.845526 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.845757 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.845845 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.846059 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.846161 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.846382 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.846490 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.846689 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.846776 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.846994 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.847101 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.847295 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.847451 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.847620 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.847708 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.847959 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.848046 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.848263 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.848359 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.848574 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.848659 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.848884 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.848970 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.849743 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.849841 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.850392 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.850497 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.850579 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.850666 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.850787 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.850876 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.851105 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.851190 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.851443 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.851546 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.851762 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.851849 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.852073 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.852160 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.852381 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.852467 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.852688 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.852775 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.853000 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.853085 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.853310 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.853403 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.853625 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.853713 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.853939 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.854025 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.854257 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.854351 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.854587 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.854795 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.854882 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.855126 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.855220 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.855447 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.855543 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.855768 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.855856 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.856081 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.856166 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.856398 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.856517 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.856711 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.856823 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.857021 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.857121 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.857330 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.857429 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.857639 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.857739 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.857948 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.858056 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.858279 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.858414 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.858598 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.858684 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.858922 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.859130 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.859258 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.859510 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.859607 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.859814 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.859910 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.860133 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.860221 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.860450 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.860536 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.860768 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.860864 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.861087 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.861176 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.861401 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.861504 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.861715 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.861810 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.862028 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.862116 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.862339 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.862424 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.862653 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.862742 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.862966 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.863052 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.863280 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.863381 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.863617 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.863712 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.863930 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.864016 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.864239 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.864325 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.864555 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.864676 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.864931 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.865592 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.865792 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.865897 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.866116 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.866214 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.866426 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.866512 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.866743 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.866855 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.867062 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.867150 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.867398 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.867497 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.867706 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.867915 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.868013 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.868231 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.868322 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.868568 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.868679 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.868891 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.868981 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.869215 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.869314 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.869528 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.869625 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.869842 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.869930 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.870164 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.870251 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.870467 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.870565 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.870772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.870861 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.871084 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.871173 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.871419 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.871513 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.871729 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.871830 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.872050 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.872248 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.872347 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.872566 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.872656 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.872900 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.872991 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.873228 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.873325 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.873554 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.873775 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.873866 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.874128 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.874218 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.874447 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.874538 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.874773 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.874864 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.875078 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.875175 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.875409 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.875513 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.875724 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.875812 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.876029 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.876132 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.876341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.876430 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.876649 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.876740 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.876953 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.877051 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.877262 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.877350 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.877566 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.877655 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.877868 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.878096 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.878203 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.878450 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.878563 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.878769 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.878882 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.879077 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.879168 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.879393 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.879488 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.879723 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.879825 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.880028 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.880118 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.880331 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.880431 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.880688 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.880813 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.881011 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.881090 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.881380 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.881487 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.881685 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.881775 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.881992 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.882079 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.882294 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.882381 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.882607 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.882709 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.882909 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.882999 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.883214 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.883304 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.883541 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.883631 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.883850 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.883939 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.884152 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.884247 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.884462 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.884560 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.884767 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.884855 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.885074 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.885163 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.885389 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.885480 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.885696 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.885786 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.886003 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.886101 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.886311 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.886403 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.886613 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.886709 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.886925 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.887278 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.887508 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.887602 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.887822 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.887929 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.888128 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.888253 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.888441 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.888675 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.888780 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.889011 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.889113 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.889330 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.889422 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.889663 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.889759 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.889992 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.890093 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.890296 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.890398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.890602 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.890691 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.890905 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.891002 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.891226 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.891326 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.891562 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.891674 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.891876 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.891973 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.892187 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.892284 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.892499 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.892588 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.892809 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.893046 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.893136 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.893383 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.893484 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.893705 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.893804 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.894012 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.894101 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.894318 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.894409 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.894624 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.894734 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.894929 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.895019 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.895236 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.895336 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.895578 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.895686 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.895889 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.895978 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.896723 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.896939 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.897040 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.897277 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.897377 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.897600 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.897714 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.897922 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.898034 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.898233 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.898323 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.898548 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.898637 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.898861 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.898960 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.899176 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.899291 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.899516 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.899631 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.899827 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.899925 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.900137 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.900236 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.900438 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.900533 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.900787 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.900883 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.901110 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.901217 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.901433 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.901529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.901754 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.901851 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.902071 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.902165 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.902382 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.902486 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.902694 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.902791 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.903004 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.903099 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.903313 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.903437 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.903654 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.903742 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.903982 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.904067 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.904296 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.904391 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.904605 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.904701 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.904946 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.905033 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.905253 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.905341 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.905557 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.905643 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.905863 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.905951 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.906180 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.906267 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.906495 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.906583 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.906806 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.906912 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.907106 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.907202 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.907430 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.907536 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.907745 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.907856 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.908048 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.908136 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.908353 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.908447 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.908657 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.908756 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.908958 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.909067 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.909265 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.909362 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.909570 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.909699 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.909870 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.909962 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.910169 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.910267 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.910471 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.910570 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.910772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.910863 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.911071 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.911161 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.911397 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.911502 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.912399 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.912906 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.913015 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.913113 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.913215 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.913298 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.913377 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.913469 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.913549 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.913670 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.913797 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.913969 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.914110 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.914202 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.914415 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.914506 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.914720 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.914818 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.915028 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.915296 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.915430 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.915532 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.915644 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.915741 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.915953 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.916042 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.916259 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.916355 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.916564 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.916659 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.916868 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.916955 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.917171 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.917265 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.917476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.917565 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.917807 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.917902 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.918118 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.918213 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.918431 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.918519 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.918741 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.918829 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.919053 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.919140 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.919421 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.919524 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.919711 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.919799 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.920017 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.920116 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.920342 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.920437 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.920662 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.920748 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.920976 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.921065 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.921291 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.921384 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.921605 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.921706 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.921916 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.922010 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.922230 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.922317 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.922540 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.922703 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.922849 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.922937 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.923157 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.923250 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.923499 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.923608 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.923820 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.923909 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.924129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.924226 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.924454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.924554 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.924773 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.924867 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.925084 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.925177 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.925403 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.925491 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.925718 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.925805 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.926050 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.926150 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.926363 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.926452 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.926676 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.926763 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.926996 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.927082 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.927332 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.927439 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.927675 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.927860 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.928068 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.928217 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.928316 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:57:30.928507 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.928842 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.929171 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.929489 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.929819 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.930150 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.930506 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.930822 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.931169 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.931598 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.931844 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.932159 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.932468 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 17:57:30.932714 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 17:57:30.990733 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO dbcounter [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Registered counter for database nova_api Jun 16 17:57:30.995540 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO dbcounter [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] Registered counter for database nova_api Jun 16 17:57:31.011804 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_db.sqlalchemy.engines [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103784) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:57:31.017073 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG oslo_db.sqlalchemy.engines [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:57:31.018893 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writer thread running {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:57:31.024931 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG dbcounter [-] [103783] Writer thread running {{(pid=103783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:57:31.078556 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.context [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15bac147-d8da-4763-a2ba-05e16398e57c(cell1) {{(pid=103784) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:57:31.082664 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:31.083384 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.context [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15bac147-d8da-4763-a2ba-05e16398e57c(cell1) {{(pid=103783) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 17:57:31.084375 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:31.085219 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:31.087258 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:31.088092 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG oslo_concurrency.lockutils [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:31.089354 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO dbcounter [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Registered counter for database nova_cell0 Jun 16 17:57:31.089720 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG oslo_concurrency.lockutils [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:31.090508 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG oslo_concurrency.lockutils [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 17:57:31.092575 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG oslo_concurrency.lockutils [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103783) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 17:57:31.093263 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO dbcounter [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Registered counter for database nova_cell1 Jun 16 17:57:31.094505 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO dbcounter [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] Registered counter for database nova_cell0 Jun 16 17:57:31.098318 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO dbcounter [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] Registered counter for database nova_cell1 Jun 16 17:57:31.100613 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_db.sqlalchemy.engines [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103784) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:57:31.102551 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_db.sqlalchemy.engines [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103784) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:57:31.105918 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG oslo_db.sqlalchemy.engines [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:57:31.107631 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG oslo_db.sqlalchemy.engines [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:57:31.109427 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writer thread running {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:57:31.111511 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writer thread running {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:57:31.113151 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG dbcounter [-] [103783] Writer thread running {{(pid=103783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:57:31.116941 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG dbcounter [-] [103783] Writer thread running {{(pid=103783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:57:31.260648 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO dbcounter [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Registered counter for database nova_cell0 Jun 16 17:57:31.266692 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO dbcounter [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] Registered counter for database nova_cell0 Jun 16 17:57:31.268985 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_db.sqlalchemy.engines [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103784) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:57:31.273531 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writer thread running {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:57:31.275865 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG oslo_db.sqlalchemy.engines [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 17:57:31.280312 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG dbcounter [-] [103783] Writer thread running {{(pid=103783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 17:57:31.736289 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: WARNING keystonemiddleware.auth_token [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:57:31.744007 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: WARNING keystonemiddleware.auth_token [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:57:31.772879 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: WARNING keystonemiddleware.auth_token [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:57:31.780127 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: WARNING keystonemiddleware.auth_token [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:57:32.094749 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: WARNING keystonemiddleware.auth_token [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:57:32.101073 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: WARNING keystonemiddleware.auth_token [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:57:32.106167 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c8e6cf99c0 pid: 103784 (default app) Jun 16 17:57:32.108239 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:57:32.109424 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Jun 16 17:57:32.109835 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Thu Jun 16 17:57:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:57:32.125463 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: WARNING keystonemiddleware.auth_token [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 17:57:32.132085 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: WARNING keystonemiddleware.auth_token [None req-d5712133-4e22-4361-b3ad-f60d8d1a5a8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 17:57:32.137713 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c8e6cf99c0 pid: 103783 (default app) Jun 16 17:58:53.027329 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:53.028374 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 16 17:58:53.029436 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:58:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:58:53.041783 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG dbcounter [-] [103783] Writing DB stats nova_api:SELECT=3 {{(pid=103783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:58:53.043002 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG dbcounter [-] [103783] Writing DB stats nova_cell1:SELECT=3 {{(pid=103783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:58:53.044031 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG dbcounter [-] [103783] Writing DB stats nova_cell0:SELECT=3 {{(pid=103783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:58:53.045429 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG dbcounter [-] [103783] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:58:53.527041 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-9771d488-f055-4b97-a824-8f76de8a6d5b admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:53.556583 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-9771d488-f055-4b97-a824-8f76de8a6d5b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.520148 Jun 16 17:58:53.557473 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Jun 16 17:58:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:58:55.772089 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:55.773663 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-e76859d4-48c6-4968-99fe-0ca1d1600fed None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002024 Jun 16 17:58:55.774049 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:58:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:58:55.837910 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-6072b531-68ce-46af-a7be-7299f21d6518 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "ram": 256, "disk": 1, "swap": 0, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:58:55.856029 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:58:55.856029 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: warnings.warn(msg) Jun 16 17:58:55.943035 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-6072b531-68ce-46af-a7be-7299f21d6518 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.162934 Jun 16 17:58:55.943806 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jun 16 17:58:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:58:55.957001 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_api:SELECT=3 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:58:55.957804 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_cell0:SELECT=3 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:58:55.958978 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_cell1:SELECT=3 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:58:55.959729 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:58:56.181712 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-fd2489ac-2aab-45b0-9f06-b7b62c4ee00c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:58:56.184166 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:58:56.184166 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: warnings.warn(msg) Jun 16 17:58:56.362336 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-fd2489ac-2aab-45b0-9f06-b7b62c4ee00c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.410399 Jun 16 17:58:56.363077 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jun 16 17:58:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:58:58.590550 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-6072b531-68ce-46af-a7be-7299f21d6518 admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:58:58.591695 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-6072b531-68ce-46af-a7be-7299f21d6518 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jun 16 17:58:58.592101 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:58:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:58:58.721617 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e36963f6-e03f-42ba-a344-f2430204ea54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:58:58.741067 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:58:58.741067 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: warnings.warn(msg) Jun 16 17:58:58.829989 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-e36963f6-e03f-42ba-a344-f2430204ea54 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.231679 Jun 16 17:58:58.830515 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jun 16 17:58:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:58:58.842383 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-e702645b-9372-4841-94f4-3ae6f4c27246 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:58:58.843983 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 17:58:58.843983 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: warnings.warn(msg) Jun 16 17:58:58.947968 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-e702645b-9372-4841-94f4-3ae6f4c27246 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109186 Jun 16 17:58:58.948564 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jun 16 17:58:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:59:01.170776 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e36963f6-e03f-42ba-a344-f2430204ea54 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:01.171873 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-e36963f6-e03f-42ba-a344-f2430204ea54 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001776 Jun 16 17:59:01.172533 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:59:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:01.236903 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-779ab6db-aace-4fab-9029-57aafa5cc91b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "swap": 0, "disk": 10, "name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:01.334251 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-779ab6db-aace-4fab-9029-57aafa5cc91b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155936 Jun 16 17:59:01.335060 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jun 16 17:59:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:59:01.348228 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-90f6f605-5bcc-4ac9-a6db-81eedecf1015 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:01.446640 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-90f6f605-5bcc-4ac9-a6db-81eedecf1015 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102488 Jun 16 17:59:01.447217 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jun 16 17:59:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:59:03.686435 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-779ab6db-aace-4fab-9029-57aafa5cc91b admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:03.687488 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-779ab6db-aace-4fab-9029-57aafa5cc91b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 16 17:59:03.687896 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:03.754218 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-5793c898-351a-4908-a7c3-666cf8c50062 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:03.846243 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-5793c898-351a-4908-a7c3-666cf8c50062 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151526 Jun 16 17:59:03.846791 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jun 16 17:59:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:59:03.859400 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-826acfb8-a0bc-411d-a8a6-09be1bd2702c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:03.947818 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-826acfb8-a0bc-411d-a8a6-09be1bd2702c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092692 Jun 16 17:59:03.948441 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jun 16 17:59:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:59:06.171279 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-5793c898-351a-4908-a7c3-666cf8c50062 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:06.172364 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-5793c898-351a-4908-a7c3-666cf8c50062 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 16 17:59:06.172763 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:06.232522 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-72ba668a-5027-47dd-9ae8-f4ed8dd620cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "name": "ds4G", "ram": 4096}} {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:06.310021 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-72ba668a-5027-47dd-9ae8-f4ed8dd620cb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131190 Jun 16 17:59:06.310614 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jun 16 17:59:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:59:06.324055 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-eaa5f380-b2b0-40f9-82d1-0cae87e429fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:06.399777 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-eaa5f380-b2b0-40f9-82d1-0cae87e429fc admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080447 Jun 16 17:59:06.400261 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Jun 16 17:59:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:59:08.615404 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-72ba668a-5027-47dd-9ae8-f4ed8dd620cb admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:08.616438 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-72ba668a-5027-47dd-9ae8-f4ed8dd620cb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 16 17:59:08.617107 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:59:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:08.679239 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e8bb7942-6181-49d0-a52d-c4a5cf3652f2 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:08.703736 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-e8bb7942-6181-49d0-a52d-c4a5cf3652f2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078863 Jun 16 17:59:08.704372 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Jun 16 17:59:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:59:10.885460 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-72ba668a-5027-47dd-9ae8-f4ed8dd620cb admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:10.887573 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-72ba668a-5027-47dd-9ae8-f4ed8dd620cb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001924 Jun 16 17:59:10.888203 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:59:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:10.949827 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-58fd8e49-1cdd-4ce8-b5f3-40b4a74b92ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:11.057667 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-58fd8e49-1cdd-4ce8-b5f3-40b4a74b92ec admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.162010 Jun 16 17:59:11.058754 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jun 16 17:59:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:59:11.076168 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-859930b1-8eca-471b-8ef8-129bd2effac6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:11.175904 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-859930b1-8eca-471b-8ef8-129bd2effac6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106318 Jun 16 17:59:11.176586 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jun 16 17:59:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:59:13.455030 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-58fd8e49-1cdd-4ce8-b5f3-40b4a74b92ec admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:13.456118 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-58fd8e49-1cdd-4ce8-b5f3-40b4a74b92ec admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jun 16 17:59:13.456526 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:13.521319 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-6592016e-ee02-4fa0-87be-edfe3dd716b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small"}} {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:13.624513 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-6592016e-ee02-4fa0-87be-edfe3dd716b9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.162050 Jun 16 17:59:13.625237 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jun 16 17:59:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 17:59:13.640366 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e4af6431-fb1f-45c6-b7ec-f12436f36edd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:13.732413 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-e4af6431-fb1f-45c6-b7ec-f12436f36edd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096612 Jun 16 17:59:13.733154 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jun 16 17:59:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:59:15.990142 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-6592016e-ee02-4fa0-87be-edfe3dd716b9 admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:15.991277 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-6592016e-ee02-4fa0-87be-edfe3dd716b9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jun 16 17:59:15.991733 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:59:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:16.051303 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-a51c81f2-3476-4c58-b51c-f0bda4dd42ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "vcpus": 2}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:16.126888 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-a51c81f2-3476-4c58-b51c-f0bda4dd42ab admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.128270 Jun 16 17:59:16.127447 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jun 16 17:59:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:59:16.140029 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-0e933a14-e178-42f9-b069-b020ea0d49cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:16.227253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-0e933a14-e178-42f9-b069-b020ea0d49cb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090866 Jun 16 17:59:16.227800 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jun 16 17:59:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 17:59:18.432372 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-a51c81f2-3476-4c58-b51c-f0bda4dd42ab admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:18.434120 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-a51c81f2-3476-4c58-b51c-f0bda4dd42ab admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002116 Jun 16 17:59:18.434520 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:59:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:18.493073 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-ff841fbd-873a-4b3d-8dd2-6541cfefa163 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "swap": 0, "disk": 80, "rxtx_factor": 1.0}} {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:18.559976 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-ff841fbd-873a-4b3d-8dd2-6541cfefa163 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.119482 Jun 16 17:59:18.560530 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jun 16 17:59:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:59:18.572468 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-a3ff76fa-91f0-472f-bfdb-6b75bccb491a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:18.656851 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-a3ff76fa-91f0-472f-bfdb-6b75bccb491a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088096 Jun 16 17:59:18.657901 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jun 16 17:59:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:59:20.885593 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-ff841fbd-873a-4b3d-8dd2-6541cfefa163 admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:20.886789 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-ff841fbd-873a-4b3d-8dd2-6541cfefa163 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Jun 16 17:59:20.887196 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:20.952097 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-68b06607-3777-487a-8555-93c7475be34e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:21.012332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-68b06607-3777-487a-8555-93c7475be34e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.119039 Jun 16 17:59:21.012897 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Jun 16 17:59:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:59:21.026751 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-d94c610c-5d97-48f3-861a-c3bffc86df9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:21.096329 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-d94c610c-5d97-48f3-861a-c3bffc86df9a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073822 Jun 16 17:59:21.097174 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Jun 16 17:59:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 17:59:46.609587 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-68b06607-3777-487a-8555-93c7475be34e admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:46.610596 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-68b06607-3777-487a-8555-93c7475be34e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 16 17:59:46.610987 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 17:59:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:46.622045 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG dbcounter [-] [103783] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:59:46.673569 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-fcd4a328-5d9b-41d0-aaf4-886a8ce1dcb3 admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:46.688540 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-fcd4a328-5d9b-41d0-aaf4-886a8ce1dcb3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071659 Jun 16 17:59:46.689072 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Jun 16 17:59:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:59:47.666998 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-68b06607-3777-487a-8555-93c7475be34e admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:47.668032 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-68b06607-3777-487a-8555-93c7475be34e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 16 17:59:47.668423 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jun 16 17:59:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:47.859561 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-905fec90-9f0f-4488-8cab-c099f37ba7df admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:47.864979 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.wsgi [None req-905fec90-9f0f-4488-8cab-c099f37ba7df admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-905fec90-9f0f-4488-8cab-c099f37ba7df admin admin] Request method failure captured: Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Accept: application/json Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Accept-Encoding: gzip, deflate Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Connection: keep-alive Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Content-Length: 0 Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Host: 10.222.0.58 Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Openstack-Api-Version: compute 2.90 Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Openstack-System-Scope: None Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: User-Agent: python-novaclient Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Auth-Token: gAAAAABiq2-TgYcBT9Ore-imefnLA_GuHdjN3Rh5IWjy5V5yZqq_psApwLWQCN_n2RUtRMJSdwQha-Pl26VJfMmkrObe5v78d_i4-QvU3JhU3nSd-8frcDNZ7DHJ-_NyU-wEB03X_5p1bCM0HsIP85keXFVVQNzlxo-coudONQC0VQ6qD7JMCT8 Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Domain-Id: None Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Domain-Name: None Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Identity-Status: Confirmed Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Is-Admin-Project: True Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Project-Domain-Id: default Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Project-Domain-Name: Default Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Project-Id: 24af7229251445019ca42ea240bb437e Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Project-Name: admin Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Role: reader,admin,member Jun 16 17:59:47.868757 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Roles: reader,admin,member Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_24af7229251445019ca42ea240bb437e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24af7229251445019ca42ea240bb437e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24af7229251445019ca42ea240bb437e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/24af7229251445019ca42ea240bb437e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Tenant: admin Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Tenant-Id: 24af7229251445019ca42ea240bb437e Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Tenant-Name: admin Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User: admin Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User-Domain-Id: default Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User-Domain-Name: Default Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User-Id: d088ec4f4ba04369a9931bed85bdd327 Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User-Name: admin Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: method: > Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: exception: Flavor 42 could not be found. Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: action_args: {'id': '42'} Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:59:47.870476 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:47.871584 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.873129 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-905fec90-9f0f-4488-8cab-c099f37ba7df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:59:47.874558 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-905fec90-9f0f-4488-8cab-c099f37ba7df admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062801 Jun 16 17:59:47.874558 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Jun 16 17:59:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:59:47.880020 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-667e3aa2-5731-4f8e-97e5-b3136d9639e6 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:47.882926 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 17:59:47.901826 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-667e3aa2-5731-4f8e-97e5-b3136d9639e6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025640 Jun 16 17:59:47.902374 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jun 16 17:59:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:59:47.912267 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-0f5aa496-0c0e-4012-9ee7-726357c528d7 admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:47.933618 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-0f5aa496-0c0e-4012-9ee7-726357c528d7 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025198 Jun 16 17:59:47.934148 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jun 16 17:59:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:59:47.943569 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-a4696a65-0203-4c21-aa29-f319bfdf74cc admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:47.949824 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.wsgi [None req-a4696a65-0203-4c21-aa29-f319bfdf74cc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-a4696a65-0203-4c21-aa29-f319bfdf74cc admin admin] Request method failure captured: Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Accept: application/json Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Accept-Encoding: gzip, deflate Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Connection: keep-alive Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Content-Length: 0 Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Host: 10.222.0.58 Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Openstack-Api-Version: compute 2.90 Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Openstack-System-Scope: None Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: User-Agent: python-novaclient Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Auth-Token: gAAAAABiq2-TgYcBT9Ore-imefnLA_GuHdjN3Rh5IWjy5V5yZqq_psApwLWQCN_n2RUtRMJSdwQha-Pl26VJfMmkrObe5v78d_i4-QvU3JhU3nSd-8frcDNZ7DHJ-_NyU-wEB03X_5p1bCM0HsIP85keXFVVQNzlxo-coudONQC0VQ6qD7JMCT8 Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Domain-Id: None Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Domain-Name: None Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Identity-Status: Confirmed Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Is-Admin-Project: True Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Project-Domain-Id: default Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Project-Domain-Name: Default Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Project-Id: 24af7229251445019ca42ea240bb437e Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Project-Name: admin Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Role: reader,admin,member Jun 16 17:59:47.953070 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Roles: reader,admin,member Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_24af7229251445019ca42ea240bb437e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24af7229251445019ca42ea240bb437e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24af7229251445019ca42ea240bb437e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/24af7229251445019ca42ea240bb437e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Tenant: admin Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Tenant-Id: 24af7229251445019ca42ea240bb437e Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Tenant-Name: admin Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User: admin Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User-Domain-Id: default Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User-Domain-Name: Default Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User-Id: d088ec4f4ba04369a9931bed85bdd327 Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User-Name: admin Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: method: > Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: exception: Flavor 42 could not be found. Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: action_args: {'id': '42'} Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:59:47.961234 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:47.962454 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:47.963772 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-a4696a65-0203-4c21-aa29-f319bfdf74cc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103784) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:59:47.965158 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-a4696a65-0203-4c21-aa29-f319bfdf74cc admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014728 Jun 16 17:59:47.965158 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Jun 16 17:59:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:59:48.841307 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-0f5aa496-0c0e-4012-9ee7-726357c528d7 admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:48.842313 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-0f5aa496-0c0e-4012-9ee7-726357c528d7 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 16 17:59:48.842706 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jun 16 17:59:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:49.034864 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-83797520-19ec-4e73-9023-00205213525b admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:49.040242 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.wsgi [None req-83797520-19ec-4e73-9023-00205213525b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-83797520-19ec-4e73-9023-00205213525b admin admin] Request method failure captured: Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Accept: application/json Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Accept-Encoding: gzip, deflate Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Connection: keep-alive Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Content-Length: 0 Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Host: 10.222.0.58 Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Openstack-Api-Version: compute 2.90 Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Openstack-System-Scope: None Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: User-Agent: python-novaclient Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Auth-Token: gAAAAABiq2-U0aApmfuF3xilGXO-NjucB1JKddeYC3C109G-rVhlojFZubT6wFpReFdsywcf8Ax-wDfP87Wffht-3ao9q28invFkoqczCnBSpMB5PvZb8sn8-RDXk7Lk5s2JQqOKLRGpd-VCT4uOUfFSaX0IPG11ROMk_4o5BBTnC98dAw-10W8 Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Domain-Id: None Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Domain-Name: None Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Identity-Status: Confirmed Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Is-Admin-Project: True Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Project-Domain-Id: default Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Project-Domain-Name: Default Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Project-Id: 24af7229251445019ca42ea240bb437e Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Project-Name: admin Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Role: reader,admin,member Jun 16 17:59:49.044933 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Roles: reader,admin,member Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_24af7229251445019ca42ea240bb437e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24af7229251445019ca42ea240bb437e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24af7229251445019ca42ea240bb437e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/24af7229251445019ca42ea240bb437e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Tenant: admin Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Tenant-Id: 24af7229251445019ca42ea240bb437e Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Tenant-Name: admin Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User: admin Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User-Domain-Id: default Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User-Domain-Name: Default Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User-Id: d088ec4f4ba04369a9931bed85bdd327 Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User-Name: admin Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: method: > Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: exception: Flavor 84 could not be found. Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: action_args: {'id': '84'} Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:59:49.047124 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:49.048642 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:49.050332 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-83797520-19ec-4e73-9023-00205213525b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103784) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:59:49.051709 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-83797520-19ec-4e73-9023-00205213525b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061726 Jun 16 17:59:49.051709 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Jun 16 17:59:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:59:49.053098 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-5441ccde-ce3a-4094-a9a7-77e60d2e3141 admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:49.069027 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-5441ccde-ce3a-4094-a9a7-77e60d2e3141 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019737 Jun 16 17:59:49.070146 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jun 16 17:59:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:59:49.080173 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-9b89a67d-5dbc-4de8-9147-18fc42192fff admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:49.095126 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-9b89a67d-5dbc-4de8-9147-18fc42192fff admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018549 Jun 16 17:59:49.095680 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jun 16 17:59:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:59:49.112219 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-b9634211-e034-4db7-92af-d05b0ed88995 admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:49.117498 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.wsgi [None req-b9634211-e034-4db7-92af-d05b0ed88995 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-b9634211-e034-4db7-92af-d05b0ed88995 admin admin] Request method failure captured: Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Accept: application/json Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Accept-Encoding: gzip, deflate Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Connection: keep-alive Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Content-Length: 0 Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Host: 10.222.0.58 Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Openstack-Api-Version: compute 2.90 Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Openstack-System-Scope: None Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: User-Agent: python-novaclient Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Auth-Token: gAAAAABiq2-U0aApmfuF3xilGXO-NjucB1JKddeYC3C109G-rVhlojFZubT6wFpReFdsywcf8Ax-wDfP87Wffht-3ao9q28invFkoqczCnBSpMB5PvZb8sn8-RDXk7Lk5s2JQqOKLRGpd-VCT4uOUfFSaX0IPG11ROMk_4o5BBTnC98dAw-10W8 Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Domain-Id: None Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Domain-Name: None Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Identity-Status: Confirmed Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Is-Admin-Project: True Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Project-Domain-Id: default Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Project-Domain-Name: Default Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Project-Id: 24af7229251445019ca42ea240bb437e Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Project-Name: admin Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Role: reader,admin,member Jun 16 17:59:49.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Roles: reader,admin,member Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_24af7229251445019ca42ea240bb437e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24af7229251445019ca42ea240bb437e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24af7229251445019ca42ea240bb437e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/24af7229251445019ca42ea240bb437e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Tenant: admin Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Tenant-Id: 24af7229251445019ca42ea240bb437e Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Tenant-Name: admin Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User: admin Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User-Domain-Id: default Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User-Domain-Name: Default Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User-Id: d088ec4f4ba04369a9931bed85bdd327 Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User-Name: admin Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: method: > Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: exception: Flavor 84 could not be found. Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: action_args: {'id': '84'} Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:59:49.120794 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:49.121701 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:49.123058 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-b9634211-e034-4db7-92af-d05b0ed88995 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:59:49.124346 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-b9634211-e034-4db7-92af-d05b0ed88995 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011885 Jun 16 17:59:49.124346 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Jun 16 17:59:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:59:49.992036 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-9b89a67d-5dbc-4de8-9147-18fc42192fff admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:49.993649 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-9b89a67d-5dbc-4de8-9147-18fc42192fff admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 16 17:59:49.994049 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jun 16 17:59:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:50.186150 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-a1113db1-6476-4d6d-9cfe-d6ef6dfc1748 admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:50.192315 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.wsgi [None req-a1113db1-6476-4d6d-9cfe-d6ef6dfc1748 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-a1113db1-6476-4d6d-9cfe-d6ef6dfc1748 admin admin] Request method failure captured: Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Accept: application/json Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Accept-Encoding: gzip, deflate Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Connection: keep-alive Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Content-Length: 0 Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Host: 10.222.0.58 Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Openstack-Api-Version: compute 2.90 Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Openstack-System-Scope: None Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: User-Agent: python-novaclient Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Auth-Token: gAAAAABiq2-VTVBQZp01WSokRK9zHJrrhCT5kZR3Wd8-3n7_MwDp0WMxFbgT-yUwuA7Ar28jfIISaWmnnQHpqWkKTDsma7KTI4mZnV2iFo1LI_XOVgaeFLy6XbhNzZklYdoEM10mJu7T_2pAvXtR5P11qgpyR-A45t94u1Eksx1XkyQPDw_SYJ4 Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Domain-Id: None Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Domain-Name: None Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Identity-Status: Confirmed Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Is-Admin-Project: True Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Project-Domain-Id: default Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Project-Domain-Name: Default Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Project-Id: 24af7229251445019ca42ea240bb437e Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Project-Name: admin Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Role: reader,admin,member Jun 16 17:59:50.193815 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Roles: reader,admin,member Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_24af7229251445019ca42ea240bb437e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24af7229251445019ca42ea240bb437e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24af7229251445019ca42ea240bb437e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/24af7229251445019ca42ea240bb437e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Tenant: admin Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Tenant-Id: 24af7229251445019ca42ea240bb437e Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-Tenant-Name: admin Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User: admin Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User-Domain-Id: default Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User-Domain-Name: Default Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User-Id: d088ec4f4ba04369a9931bed85bdd327 Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: X-User-Name: admin Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: method: > Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: exception: Flavor 451 could not be found. Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: action_args: {'id': '451'} Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:59:50.195402 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:50.196398 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: ERROR nova.api.openstack.wsgi Jun 16 17:59:50.198253 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-a1113db1-6476-4d6d-9cfe-d6ef6dfc1748 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103783) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:59:50.199525 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-a1113db1-6476-4d6d-9cfe-d6ef6dfc1748 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060119 Jun 16 17:59:50.199525 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jun 16 17:59:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:59:50.205416 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-9e363aec-c91c-42a4-93f4-ba80fba12843 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:50.226494 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-9e363aec-c91c-42a4-93f4-ba80fba12843 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024348 Jun 16 17:59:50.227457 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jun 16 17:59:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 17:59:50.236940 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:50.251842 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018327 Jun 16 17:59:50.252384 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Jun 16 17:59:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 17:59:50.263126 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e351f33a-9109-46e6-a799-b9d2d3e05ebd admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:50.269364 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.wsgi [None req-e351f33a-9109-46e6-a799-b9d2d3e05ebd admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e351f33a-9109-46e6-a799-b9d2d3e05ebd admin admin] Request method failure captured: Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Accept: application/json Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Accept-Encoding: gzip, deflate Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Connection: keep-alive Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Content-Length: 0 Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Host: 10.222.0.58 Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Openstack-Api-Version: compute 2.90 Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Openstack-System-Scope: None Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: User-Agent: python-novaclient Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Auth-Token: gAAAAABiq2-VTVBQZp01WSokRK9zHJrrhCT5kZR3Wd8-3n7_MwDp0WMxFbgT-yUwuA7Ar28jfIISaWmnnQHpqWkKTDsma7KTI4mZnV2iFo1LI_XOVgaeFLy6XbhNzZklYdoEM10mJu7T_2pAvXtR5P11qgpyR-A45t94u1Eksx1XkyQPDw_SYJ4 Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Domain-Id: None Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Domain-Name: None Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Identity-Status: Confirmed Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Is-Admin-Project: True Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Project-Domain-Id: default Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Project-Domain-Name: Default Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Project-Id: 24af7229251445019ca42ea240bb437e Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Project-Name: admin Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Role: reader,admin,member Jun 16 17:59:50.270838 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Roles: reader,admin,member Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_24af7229251445019ca42ea240bb437e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24af7229251445019ca42ea240bb437e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24af7229251445019ca42ea240bb437e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/24af7229251445019ca42ea240bb437e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Tenant: admin Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Tenant-Id: 24af7229251445019ca42ea240bb437e Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-Tenant-Name: admin Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User: admin Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User-Domain-Id: default Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User-Domain-Name: Default Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User-Id: d088ec4f4ba04369a9931bed85bdd327 Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: X-User-Name: admin Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: method: > Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: exception: Flavor 451 could not be found. Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: action_args: {'id': '451'} Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 17:59:50.272501 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:50.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: ERROR nova.api.openstack.wsgi Jun 16 17:59:50.274529 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-e351f33a-9109-46e6-a799-b9d2d3e05ebd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103784) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 17:59:50.275566 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-e351f33a-9109-46e6-a799-b9d2d3e05ebd admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013725 Jun 16 17:59:50.275566 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jun 16 17:59:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 17:59:51.145069 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:51.146101 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 16 17:59:51.146500 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jun 16 17:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:51.336394 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-f913784a-c9c4-4f0e-bc20-494545a58860 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:51.416170 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-f913784a-c9c4-4f0e-bc20-494545a58860 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.131418 Jun 16 17:59:51.416704 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Jun 16 17:59:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:59:52.285127 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:52.286205 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 16 17:59:52.286700 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jun 16 17:59:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:52.482218 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-5172fde8-5e61-413f-a0c4-6d19d0fe026f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:52.551048 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-5172fde8-5e61-413f-a0c4-6d19d0fe026f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.121384 Jun 16 17:59:52.551718 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Jun 16 17:59:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:59:53.421250 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:53.422256 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 16 17:59:53.422692 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jun 16 17:59:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:53.614405 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-7791f3f3-46f4-4997-9165-0c7f5d95719b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:53.693363 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-7791f3f3-46f4-4997-9165-0c7f5d95719b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.130532 Jun 16 17:59:53.696440 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Jun 16 17:59:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:59:54.574721 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:54.575764 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 16 17:59:54.576186 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jun 16 17:59:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:54.769981 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-531571e5-7b22-486a-9e89-12aec94cf12d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 17:59:54.853730 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-531571e5-7b22-486a-9e89-12aec94cf12d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.136852 Jun 16 17:59:54.854186 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Jun 16 17:59:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 17:59:55.732754 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:55.734107 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002182 Jun 16 17:59:55.734512 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jun 16 17:59:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 17:59:55.928724 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-4cca7ec2-2040-45dd-a919-cf8c0272452e admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 17:59:55.948780 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-4cca7ec2-2040-45dd-a919-cf8c0272452e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074664 Jun 16 17:59:55.949314 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Thu Jun 16 17:59:55 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:00:45.124969 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:00:45.126029 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-849040ae-3214-4e08-9ef9-105622dbc48a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 16 18:00:45.126425 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 930 bytes} [Thu Jun 16 18:00:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:00:45.137174 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:00:45.185570 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-50b32684-4ba6-42d4-8ca7-12fb3c0bf30e admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:00:45.204356 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-50b32684-4ba6-42d4-8ca7-12fb3c0bf30e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071716 Jun 16 18:00:45.204879 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Jun 16 18:00:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:00:45.228441 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-c4fe2d22-9b09-4b13-8646-539de62791a5 admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:00:45.231845 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG dbcounter [-] [103783] Writing DB stats nova_api:SELECT=14 {{(pid=103783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:00:45.236780 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-c4fe2d22-9b09-4b13-8646-539de62791a5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011927 Jun 16 18:00:45.237858 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1282 bytes} [Thu Jun 16 18:00:45 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:00:45.249394 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-35d417b6-30e0-4810-a290-12814c79b7e6 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:00:45.257751 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-35d417b6-30e0-4810-a290-12814c79b7e6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011909 Jun 16 18:00:45.258281 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1285 bytes} [Thu Jun 16 18:00:45 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:00:45.269780 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-7e8559ab-e1f7-4736-9b30-226b8c46c9fe admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:00:45.277593 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-7e8559ab-e1f7-4736-9b30-226b8c46c9fe admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011520 Jun 16 18:00:45.278090 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1285 bytes} [Thu Jun 16 18:00:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:00:45.289701 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-17a571ab-adf4-468c-8b55-12a663e39d52 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:00:45.297223 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-17a571ab-adf4-468c-8b55-12a663e39d52 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011024 Jun 16 18:00:45.297748 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1282 bytes} [Thu Jun 16 18:00:45 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:04:16.292750 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-7e8559ab-e1f7-4736-9b30-226b8c46c9fe admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:04:16.293759 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-7e8559ab-e1f7-4736-9b30-226b8c46c9fe admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 16 18:04:16.294153 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jun 16 18:04:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:04:16.453009 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_api:SELECT=6 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:04:16.575294 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-70cf6a4f-4eb0-4d1a-ab1c-5e75d60cd62e admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:04:16.576545 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:04:16.576545 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: warnings.warn(msg) Jun 16 18:04:16.577759 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-70cf6a4f-4eb0-4d1a-ab1c-5e75d60cd62e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:04:16.578204 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-70cf6a4f-4eb0-4d1a-ab1c-5e75d60cd62e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:04:16.578986 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-70cf6a4f-4eb0-4d1a-ab1c-5e75d60cd62e admin admin] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:04:16.579450 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-70cf6a4f-4eb0-4d1a-ab1c-5e75d60cd62e admin admin] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:04:16.618799 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-70cf6a4f-4eb0-4d1a-ab1c-5e75d60cd62e admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.166274 Jun 16 18:04:16.620293 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jun 16 18:04:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:04:17.533049 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-7e8559ab-e1f7-4736-9b30-226b8c46c9fe admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:04:17.534050 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-7e8559ab-e1f7-4736-9b30-226b8c46c9fe admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 16 18:04:17.534440 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jun 16 18:04:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:04:17.739346 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-9a46d532-6832-4f43-82bb-b07d8bd4c79d admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:04:17.740622 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:04:17.740622 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: warnings.warn(msg) Jun 16 18:04:17.742002 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-9a46d532-6832-4f43-82bb-b07d8bd4c79d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:04:17.742433 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-9a46d532-6832-4f43-82bb-b07d8bd4c79d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:04:17.743653 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-9a46d532-6832-4f43-82bb-b07d8bd4c79d admin admin] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:04:17.744361 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-9a46d532-6832-4f43-82bb-b07d8bd4c79d admin admin] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:04:17.764918 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-9a46d532-6832-4f43-82bb-b07d8bd4c79d admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085204 Jun 16 18:04:17.765631 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jun 16 18:04:17 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:04:29.088296 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-7e8559ab-e1f7-4736-9b30-226b8c46c9fe admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:04:29.089303 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-7e8559ab-e1f7-4736-9b30-226b8c46c9fe admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 16 18:04:29.089705 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jun 16 18:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:04:29.236150 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_cell0:SELECT=4 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:04:29.236916 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_cell1:SELECT=4 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:04:29.237561 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG dbcounter [-] [103784] Writing DB stats nova_api:SELECT=8 {{(pid=103784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:04:29.292371 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-a02c2100-6d13-46fe-8e4a-6305a1a6d7ee admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:04:29.293536 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:04:29.293536 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: warnings.warn(msg) Jun 16 18:04:29.294744 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-a02c2100-6d13-46fe-8e4a-6305a1a6d7ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:04:29.295170 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-a02c2100-6d13-46fe-8e4a-6305a1a6d7ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:04:29.295974 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-a02c2100-6d13-46fe-8e4a-6305a1a6d7ee admin admin] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:04:29.296398 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-a02c2100-6d13-46fe-8e4a-6305a1a6d7ee admin admin] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:04:29.321702 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-a02c2100-6d13-46fe-8e4a-6305a1a6d7ee admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089875 Jun 16 18:04:29.322191 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jun 16 18:04:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:04:30.212265 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: DEBUG nova.api.openstack.wsgi [None req-7e8559ab-e1f7-4736-9b30-226b8c46c9fe admin admin] Calling method '>' {{(pid=103783) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:04:30.213269 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: INFO nova.api.openstack.requestlog [None req-7e8559ab-e1f7-4736-9b30-226b8c46c9fe admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 16 18:04:30.213674 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: [pid: 103783|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Jun 16 18:04:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:04:30.406168 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG nova.api.openstack.wsgi [None req-a52848f3-d350-4bd4-b2c3-86cf37b20b35 admin admin] Calling method '>' {{(pid=103784) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:04:30.407333 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:04:30.407333 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: warnings.warn(msg) Jun 16 18:04:30.408540 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-a52848f3-d350-4bd4-b2c3-86cf37b20b35 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:04:30.408979 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-a52848f3-d350-4bd4-b2c3-86cf37b20b35 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:04:30.409787 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-a52848f3-d350-4bd4-b2c3-86cf37b20b35 admin admin] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:04:30.410255 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: DEBUG oslo_concurrency.lockutils [None req-a52848f3-d350-4bd4-b2c3-86cf37b20b35 admin admin] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103784) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:04:30.433240 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: INFO nova.api.openstack.requestlog [None req-a52848f3-d350-4bd4-b2c3-86cf37b20b35 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079983 Jun 16 18:04:30.433791 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: [pid: 103784|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Jun 16 18:04:30 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:05:31.343680 dv-cinder-837543-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 18:05:31.344241 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: Thu Jun 16 18:05:31 2022 - graceful shutdown triggered... Jun 16 18:05:31.344674 dv-cinder-837543-4-iscsi devstack@n-api.service[103784]: Gracefully killing worker 2 (pid: 103784)... Jun 16 18:05:31.345030 dv-cinder-837543-4-iscsi devstack@n-api.service[103783]: Gracefully killing worker 1 (pid: 103783)... Jun 16 18:05:32.345406 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: worker 1 buried after 1 seconds Jun 16 18:05:32.345406 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: worker 2 buried after 1 seconds Jun 16 18:05:32.346149 dv-cinder-837543-4-iscsi devstack@n-api.service[103782]: goodbye to uWSGI. Jun 16 18:05:32.347081 dv-cinder-837543-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 18:05:32.347706 dv-cinder-837543-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 18:05:32.350821 dv-cinder-837543-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 18:05:32.361686 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 18:05:32 2022] *** Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: nodename: dv-cinder-837543-4-iscsi Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: machine: x86_64 Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: clock source: unix Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: pcre jit disabled Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: detected number of CPU cores: 4 Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: current working directory: / Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: detected binary path: /usr/bin/uwsgi-core Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: your processes number limit is 47680 Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: your memory page size is 4096 bytes Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: detected max file descriptor number: 2048 Jun 16 18:05:32.365142 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: lock engine: pthread robust mutexes Jun 16 18:05:32.366092 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: thunder lock: enabled Jun 16 18:05:32.366092 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 18:05:32.366092 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 18:05:32.413112 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: Python main interpreter initialized at 0x55d463d509c0 Jun 16 18:05:32.413112 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: python threads support enabled Jun 16 18:05:32.413112 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: your server socket listen backlog is limited to 100 connections Jun 16 18:05:32.413112 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: your mercy for graceful operations on workers is 90 seconds Jun 16 18:05:32.413776 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 18:05:32.413776 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: *** Operational MODE: preforking *** Jun 16 18:05:32.414057 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: *** uWSGI is running in multiple interpreter mode *** Jun 16 18:05:32.414057 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: spawned uWSGI master process (pid: 118139) Jun 16 18:05:32.414074 dv-cinder-837543-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 18:05:32.414655 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: spawned uWSGI worker 1 (pid: 118161, cores: 1) Jun 16 18:05:32.423596 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: spawned uWSGI worker 2 (pid: 118162, cores: 1) Jun 16 18:05:32.423596 dv-cinder-837543-4-iscsi devstack@n-api.service[118139]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 18:05:33.090754 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:05:33.099598 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:05:34.365821 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:05:34.365821 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: from cryptography.utils import int_from_bytes Jun 16 18:05:34.366457 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:05:34.366457 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: from cryptography.utils import int_from_bytes Jun 16 18:05:34.375032 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:05:34.375032 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: from cryptography.utils import int_from_bytes Jun 16 18:05:34.375032 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:05:34.375032 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: from cryptography.utils import int_from_bytes Jun 16 18:05:36.841456 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:05:36.842165 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:05:36.842336 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:05:36.842592 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:05:36.842856 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:05:36.843260 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.843610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.843934 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.844258 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.844596 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.844933 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.845239 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.845564 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.845895 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.846161 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.846479 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.846810 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-4-iscsi {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.847138 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.847613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.847936 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.848263 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.848574 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.848933 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.849212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.849724 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.851578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.851578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.851578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.851578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.851578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.852079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.852079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.852347 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.852695 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.853023 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.853444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-4-iscsi {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.853779 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.854125 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.854414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.854759 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.855133 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.855504 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.855889 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.856201 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.856572 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.856864 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.857051 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.857590 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.857590 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.857892 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.858187 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.858499 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.858825 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.859134 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.859479 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.859721 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.860036 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.860362 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.860689 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.861023 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.861280 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.861534 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.861858 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.862182 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.862764 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.863628 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.863940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.864251 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.864562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.864875 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.865181 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.865504 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.865806 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.866130 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.866758 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.866758 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.867069 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.867500 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.867758 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.868067 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.868413 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.868745 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.869057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.869381 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.869707 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.870020 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.870331 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.870642 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.870966 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.871310 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.871658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.871914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.872222 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.872532 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.872857 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.873166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.873476 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.873786 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.874090 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.874397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.874706 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.875015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.875321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.875654 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.875962 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.876271 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.876580 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.876888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.877210 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.877537 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.877846 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.878154 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.878463 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.879422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.879670 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.880140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.880455 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.880782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.881096 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.881410 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.881734 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.882052 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.882361 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.882683 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.882990 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.883301 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.883669 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.883980 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.884293 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.884604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.884913 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.885225 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.885536 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.885845 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.886154 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.886459 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.886785 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.887108 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.887449 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.887767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.888078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.888402 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.888749 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.889080 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.889425 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.889744 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.890080 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.890414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.890737 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.891056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.891394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.891738 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.895594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.895594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.895594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.895594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.895594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.895594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.895594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.895594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.899774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.900300 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.900300 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.900547 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.900815 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.901204 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.901523 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.901845 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.902192 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.902514 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.902917 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.903239 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.903594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.903913 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.904229 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.904544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.904855 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.905164 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.905477 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.905793 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.906101 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.906429 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.906762 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.907071 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.907433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.907751 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.908070 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.908387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.908701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.909010 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.909326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.909643 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.910056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.910386 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.910705 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.911016 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.911343 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.911682 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.911992 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.912311 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.912627 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.912943 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.913260 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.913578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.913793 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:05:36.914223 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.914321 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:05:36.914408 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.914503 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.914596 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:05:36.914839 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.914941 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:05:36.915173 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.915278 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:05:36.915508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.915606 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.915840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.915955 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.916165 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.916267 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.916488 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.916593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.916794 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.916896 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.917111 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.917232 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.917416 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.917511 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.917746 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.917891 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.918036 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.918141 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.918472 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.918608 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.918756 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.918898 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.919027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.919562 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-4-iscsi {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.919716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.919716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.919942 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.920062 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.920191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.920314 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.920435 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.920548 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.920660 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.920866 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.920997 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.921121 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.921243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.921365 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.921485 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.921690 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.921937 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.922077 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.922255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.922384 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.922569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.922702 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.922887 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.923017 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.923231 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.923352 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.923579 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.927447 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.927560 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.927641 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.927714 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.927800 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.927882 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.927991 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.928075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.928155 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.928228 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.928307 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.928307 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.928447 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-4-iscsi {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.928543 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.928619 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.928699 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.928780 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.928879 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.928961 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.929034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.929104 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.929183 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.929268 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.929340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.929417 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.929488 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.929559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.929629 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.929712 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.929791 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.929863 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.929941 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.930019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.930118 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.930199 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.930279 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.930357 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.930436 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.930508 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.930578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.930647 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.930780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.930967 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.931062 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.931285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.931417 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.931713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.931873 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.931954 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.932034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.932491 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.932599 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.932690 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.932771 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.932843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.932914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.933145 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.933247 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.933418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.933519 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.933748 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.933850 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.934038 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.934144 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.934310 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.934417 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.934579 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.934669 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.934907 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.934998 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.935221 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.935310 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.935626 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.935725 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.935861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.935957 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.936175 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.936268 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.936484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.936575 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.936795 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.936885 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.937109 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.937200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.937421 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.937521 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.937733 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.937823 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.938050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.938132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.938367 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.938449 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.938678 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.938773 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.938984 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.939071 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.939301 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.939873 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.939975 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.940051 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.940122 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.940193 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.940270 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.940350 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.940526 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.940622 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.940852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.940943 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.941730 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.941855 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.942411 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.942532 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.942532 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.942672 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.942750 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.942837 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.943052 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.943163 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.943419 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.943515 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.943787 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.943900 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.944202 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.944299 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.944299 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.944457 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.944612 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.944719 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.944867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.944949 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.945193 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.945283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.945507 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.945596 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.945817 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.945899 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.946129 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.946226 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.946437 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.946540 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.946747 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.946829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.947060 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.947148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.947963 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.948137 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.948292 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.948450 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.948612 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.948754 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.948905 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.949056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.949200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.949342 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.949484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.949634 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.949776 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.949931 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.950086 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.950230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.950372 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.950533 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.950683 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.950834 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.950976 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.951125 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.951273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.951462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.951623 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.951766 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.951922 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.952072 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.952222 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.952376 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.952518 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.952665 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.952817 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.952817 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.953086 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.953227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.953384 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.953669 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.953845 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.954078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.954226 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.954457 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.954625 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.954876 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.955027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.955183 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.955335 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.955548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.955694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.955855 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.956013 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.956157 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.956299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.956467 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.956712 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.956879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.957039 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.957191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.957343 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.957487 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.957637 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.957780 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.957929 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.958167 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.958327 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.958477 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.958757 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.958903 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.959056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.959207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.959465 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.959616 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.959761 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.959910 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.960066 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.960217 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.960369 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.960512 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.960660 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.960804 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:05:36.960964 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.961121 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.961265 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.961407 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.961549 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.961698 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.961849 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.962001 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.962144 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.962301 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.962453 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.962596 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.962737 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.962903 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.963054 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.963197 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.963339 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.963519 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.963815 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.963977 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.964220 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.964412 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.964647 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.964803 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.965059 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.965221 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.965364 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.965506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.965655 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.965797 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.965947 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.966098 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.966247 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.966397 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.966547 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.966715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.966939 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.967097 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.967250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.967250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.967600 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.967752 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.967901 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.968044 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.968205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.968425 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.968581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.968738 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.968889 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.969038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.969181 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.969334 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.969484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.969640 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.969789 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.969943 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.970086 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.970228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.970369 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.970524 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.970666 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.970808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.970949 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.971090 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.971255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.971437 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.971594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.971746 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.971888 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.972037 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.972194 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.972398 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.972552 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.972705 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.972893 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.973071 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.973225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.973381 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.973524 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.973665 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.973946 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.974103 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.974103 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.974808 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.974965 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.975209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.975416 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.975580 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.975725 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.975878 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.976027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.976170 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.976311 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.976461 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.976612 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.976762 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.976922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.977134 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.977288 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.977445 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.977596 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.977739 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.977900 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.978043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.978184 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.978336 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.978573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.978725 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.978876 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.979218 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.979407 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.979572 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.979726 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.979890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.980034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.980188 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.980363 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.980512 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.980693 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.980863 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.981040 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.981194 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.981346 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.981489 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.981630 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.981781 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.981923 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.982073 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.982240 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.982397 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.982541 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.982682 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.982832 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.982988 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.983140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.983282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.983463 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.983612 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.983754 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.984056 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.984222 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.984366 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.984516 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.984786 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.985005 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.985168 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.985422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.985570 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.985712 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.985853 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.986004 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.986159 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.986302 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.986462 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.986611 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.986754 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.986895 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.987050 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.987283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.987719 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.988391 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.988677 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.988872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.989067 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.989220 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.989220 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.989536 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.989536 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.989914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.989914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.990187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.990340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.990490 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.990639 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.990823 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.990969 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.991112 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.991112 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.991546 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.991748 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.991983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.991983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.992285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.992428 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.992577 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.992728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.992878 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.993021 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.993168 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.993168 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.993445 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.993601 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.993755 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.993898 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.994189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.994352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.994629 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.994806 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.995049 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.995264 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.995454 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.995695 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.995854 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.996005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.996159 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.996309 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.996464 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.996464 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.996812 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.996983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.997872 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.998050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.998198 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.998341 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.998498 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.998643 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.998875 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.999037 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.999180 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.999322 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.999523 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.999671 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.999813 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:36.999813 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.000098 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.000254 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.000404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.000546 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.000698 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.000841 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.000993 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.001145 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.001296 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.001447 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.001597 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.001597 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.001874 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.002030 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.002175 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.002325 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.002475 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.002475 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.002754 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.002927 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.003084 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.003227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.003421 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.004333 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.004582 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.004878 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.005057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.005057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.005533 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.005533 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.006010 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.006182 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.006335 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.006335 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.006614 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.006757 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.006910 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.007068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.007212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.007377 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.007546 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.007689 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.007934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.008085 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.008247 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.008247 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.008518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.008661 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.008817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.009061 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.009218 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.009362 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.009511 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.009665 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.009809 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.009951 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.010113 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.010267 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.010410 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.010561 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.010710 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.010853 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.011003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.011153 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.011297 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.011504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.011651 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.011793 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.011942 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.012085 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.012246 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.012403 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.012546 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.012689 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.012839 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.012988 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.013139 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.013283 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.013433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.013585 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.013736 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.013880 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.014041 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.014185 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.014423 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.014572 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.014724 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.014885 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.015117 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.015267 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.015558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.015782 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.015948 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.016195 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.016360 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.016516 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.016660 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.016802 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.016952 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.017111 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.017262 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.017454 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.017604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.017755 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.017917 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.018151 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.018308 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.018453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.018615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.018759 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.018901 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.019080 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.019397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.019563 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.019716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.019860 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.020021 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.020175 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.020319 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.020469 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.020613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.020766 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.020918 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.021069 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.021301 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.021774 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.022130 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.022284 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.022439 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.022591 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.022735 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.022885 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.023028 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.023189 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.023341 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.023524 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.023679 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.023830 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.023973 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.024122 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.024407 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.024638 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.024797 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.024950 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.025120 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.025360 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.025536 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.025799 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.026041 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.026189 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.026340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.026594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.026746 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.026890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.026890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.027169 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.027310 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.027521 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.027674 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.027839 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.027985 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.028145 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.028382 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.028544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.028688 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.028837 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.028988 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.029130 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.029286 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.029533 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.029533 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.029819 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.029985 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.030130 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.030281 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.030425 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.030574 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.030724 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.030874 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.031018 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.031170 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.031313 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.031519 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.031671 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.031829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.031972 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.032124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.032124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.032395 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.032537 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.032693 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.032693 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.032970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.033114 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.033262 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.033413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.033563 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.033563 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.033844 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.033985 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.034135 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.034135 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.034416 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.034843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.034971 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.035084 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.051518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.051763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.051918 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.052006 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.052083 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.052156 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.052242 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.052464 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.052558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.052636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.052708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.052793 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.052882 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.052956 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053036 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053196 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053277 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053358 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053431 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053512 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053585 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053816 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053887 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.053958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054110 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054194 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054268 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054349 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054424 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054519 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054519 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054666 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054739 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054811 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054895 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.054999 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.055080 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.055162 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.055235 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.055306 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.056950 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057052 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057052 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057293 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057367 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057447 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057520 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057606 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057680 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057759 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057833 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057905 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.057976 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.058074 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.058157 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.058231 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.058304 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.058383 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.058466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.058546 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.058620 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.058719 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.058794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.058865 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.058946 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.059027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.059102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.059102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.059247 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.059322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.059826 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.059989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.060141 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.060292 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.060462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.060623 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.060784 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.060944 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.061104 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.061256 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.061422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.061602 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.061754 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.061911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.062069 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.062228 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.062410 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.062570 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.062728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.062882 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.063032 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.063192 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.063343 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.063521 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.063684 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.067493 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.067690 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.067881 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.068193 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.068378 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.068631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.068811 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.068977 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.069131 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.069284 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.069444 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.069596 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.069754 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.069754 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.070061 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.070215 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.070366 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.070529 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.082216 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.082873 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.083050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.083212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.083400 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.083566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.086128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.086349 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.086514 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.086713 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.086883 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.087063 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.087226 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.087434 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.087608 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.087772 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.087924 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.088090 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.088334 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.088496 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.088656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.088809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.088960 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.089110 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.089284 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.089444 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.089602 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.089754 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.089904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.090055 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.090234 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.090428 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.090428 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.090784 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.090973 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.091135 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.091294 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.091521 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.091678 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.091849 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.092002 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.092161 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.092313 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.092463 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.092621 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.092773 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.092925 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.093088 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.093248 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.094276 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.094455 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.094609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.094786 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.094978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.095139 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.095255 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.095255 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.095531 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.196291 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.196594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.196797 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.196987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.197153 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.197317 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.197451 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.197571 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.197700 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.197835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.197946 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.198132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.198350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.198537 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.198734 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.198859 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.198964 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.199060 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.199173 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.199273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.199391 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.199527 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.199742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.199960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.200211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.200444 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.200658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.200853 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.201000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.201156 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.201297 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.201388 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.201483 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.207292 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.208041 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.208148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.208248 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.208348 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.208446 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.208558 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.208651 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.208749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.208848 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.208952 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.209047 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.209144 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.209237 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.209335 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.209429 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.209532 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.209628 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.209725 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.209814 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.209907 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.210001 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.210100 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.210188 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.210286 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.210374 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.210471 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.210568 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.210669 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.210763 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.210876 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.210979 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.211100 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.211197 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.211197 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.211349 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.211475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.211571 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.211670 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.211670 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.211853 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.211946 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.212034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.212151 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.212250 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.212351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.212473 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.212578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.212667 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.212792 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.212913 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.213033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.213136 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.213260 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.213393 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.213528 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.213661 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.213766 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.213766 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.213980 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.214080 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.214080 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.214290 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.214387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.214501 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.214501 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.214717 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.214853 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.214960 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.215049 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.215172 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.215344 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.215473 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.215608 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.215702 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.215702 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.215702 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.215702 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.216150 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.216255 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.216255 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.216402 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.216484 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.216641 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.216736 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.216842 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.216937 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.217031 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.217164 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.217261 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.217365 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.217493 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.217623 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.217716 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.217805 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.217892 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.218019 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.218112 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.218223 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.218320 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.218436 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.218595 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.218777 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.218885 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.218991 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.218991 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.219216 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.219341 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.219541 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.219640 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.219728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.219839 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.219949 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.220054 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.220171 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.220295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.220403 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.220493 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.220600 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.220703 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.220703 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.220896 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.220984 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.221078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.221173 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.221269 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.221358 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.221358 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.221514 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.221600 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.221600 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.221774 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.221872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.221872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.222083 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.222181 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.222374 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.222500 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.222608 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.222794 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.222934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.223053 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.223193 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.223291 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.223421 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.223560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.223668 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.223767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.223869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.223958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.224044 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.224130 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.224204 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.224304 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.224304 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.224452 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.224539 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.224624 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.224721 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.224822 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.224920 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.225016 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.225107 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.225182 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.225376 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.225556 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.225655 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.225752 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.225847 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.225935 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226028 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.226843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.227624 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.227810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.227810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.228078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.228192 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.228331 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.228432 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.228556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.228556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.228731 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.228829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.228969 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.229069 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.229166 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.229268 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.229364 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.229451 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.229547 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.229648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.229743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.229846 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.229939 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.230033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.230140 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.230140 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.230341 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.230438 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.230620 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.230721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.230809 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.231648 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.231764 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.231862 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.231942 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.232018 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.232104 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.232187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.232262 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.232373 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.232467 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.232551 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.232636 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.232712 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.232794 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.232901 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.232984 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.233065 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.233152 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.233233 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.233309 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.233389 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.233481 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.233586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.233663 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.233736 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.233809 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.233897 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.233979 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.234067 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.234149 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.234249 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.234336 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.234412 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.234492 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.234581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.234666 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.234814 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.234898 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.234981 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.235056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.235151 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.235251 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.235333 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.235465 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.235556 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.235662 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.235745 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.235820 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.235820 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.235963 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.236036 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.236139 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.236233 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.236308 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.236308 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.236455 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.236529 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.236645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.236734 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.236809 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.236809 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.237020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.237154 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:05:37.237255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.237255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.237255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.237255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.237255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.237255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.237255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.237255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.238858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.238858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.238858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.238858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.238858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.238858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.238858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.239750 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.239750 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.239750 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.239750 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.239750 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.239750 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.240294 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO dbcounter [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] Registered counter for database nova_api Jun 16 18:05:37.240715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.240715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.240715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.240715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.240715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.240715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.240715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.240715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.241424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.241424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.241424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.241424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.241424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.241424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.241424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.241424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.242132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.242132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.242132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.242132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.242132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.242132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.242132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.242132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.242753 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.242753 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.242753 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.242997 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.244631 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.244631 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.244631 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.244631 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.245831 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.246146 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.246485 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.246809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.247208 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.247502 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.247832 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.248136 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.248535 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.249058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.249439 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.249769 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.250157 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.250629 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.251132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.252932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.252932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.252932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.252932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.252932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.255272 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.255272 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.255272 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.255272 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.255272 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.256309 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.256309 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.256309 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.257076 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.257076 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.257630 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.257630 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.258203 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.258554 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.258900 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.259204 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.260346 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.260346 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.260346 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.261070 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.261070 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.261651 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.261913 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.262369 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.262762 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.263098 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.263438 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_db.sqlalchemy.engines [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:05:37.263693 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.263918 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.264142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.264460 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.264792 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.265137 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.265458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.265779 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.266355 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.266523 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.266747 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.267065 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.267399 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.267718 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.268036 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.268353 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.269306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.269306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.269678 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.269936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.270323 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.270655 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.271045 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.271382 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.271730 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writer thread running {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:05:37.271912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.272070 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.272328 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.272702 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.273151 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.273481 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.273820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.274143 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.274456 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.274895 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.275219 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.275574 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.275904 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.276322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.276555 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.276882 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.277200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.277531 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.277851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.278188 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.278534 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.278870 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.279201 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.279545 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.279858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.280168 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.280484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.280810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.281125 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.281433 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.281742 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.282059 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.282371 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.282682 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.282992 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.283302 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.283642 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.283949 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.284256 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.284563 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.285474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.285781 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.286089 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.286409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.286719 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.287121 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.287462 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.287774 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.288081 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.288425 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.288860 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.289091 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.289420 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.289738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.290073 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.290390 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.290718 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.291057 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.291409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.291706 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.292048 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.292367 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.292688 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.293005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.293323 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.293639 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.293957 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.294310 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.294626 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.294935 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.295266 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.295688 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.295945 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.296267 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.296649 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.296919 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.297236 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.297551 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.297891 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.298185 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.298500 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.298820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.299142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.299500 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.303586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.303586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.303586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.303586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.303586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.303586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.303586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.303586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.304305 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.304305 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.304305 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:05:37.304305 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:05:37.330366 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.context [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15bac147-d8da-4763-a2ba-05e16398e57c(cell1) {{(pid=118162) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:05:37.334644 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:05:37.338040 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:05:37.338040 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:05:37.339232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:05:37.341261 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO dbcounter [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] Registered counter for database nova_cell0 Jun 16 18:05:37.345151 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO dbcounter [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] Registered counter for database nova_cell1 Jun 16 18:05:37.352806 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_db.sqlalchemy.engines [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:05:37.354814 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_db.sqlalchemy.engines [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:05:37.360406 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writer thread running {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:05:37.364323 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writer thread running {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:05:37.367933 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO dbcounter [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] Registered counter for database nova_api Jun 16 18:05:37.388220 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_db.sqlalchemy.engines [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:05:37.397024 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writer thread running {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:05:37.458514 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.context [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15bac147-d8da-4763-a2ba-05e16398e57c(cell1) {{(pid=118161) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:05:37.462778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:05:37.464419 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:05:37.465239 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:05:37.467207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:05:37.469255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO dbcounter [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] Registered counter for database nova_cell0 Jun 16 18:05:37.473856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO dbcounter [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] Registered counter for database nova_cell1 Jun 16 18:05:37.482834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_db.sqlalchemy.engines [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:05:37.485220 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_db.sqlalchemy.engines [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:05:37.492435 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writer thread running {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:05:37.495230 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writer thread running {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:05:37.515024 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO dbcounter [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] Registered counter for database nova_cell0 Jun 16 18:05:37.522075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_db.sqlalchemy.engines [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:05:37.526876 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writer thread running {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:05:37.647879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO dbcounter [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] Registered counter for database nova_cell0 Jun 16 18:05:37.656758 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_db.sqlalchemy.engines [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:05:37.661478 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writer thread running {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:05:37.851027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: WARNING keystonemiddleware.auth_token [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:05:37.858328 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: WARNING keystonemiddleware.auth_token [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:05:37.985820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: WARNING keystonemiddleware.auth_token [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:05:37.995073 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: WARNING keystonemiddleware.auth_token [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:05:38.211021 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: WARNING keystonemiddleware.auth_token [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:05:38.217936 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: WARNING keystonemiddleware.auth_token [None req-06d52139-5f14-4923-a1b1-bebd2eba34c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:05:38.224060 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d463d509c0 pid: 118162 (default app) Jun 16 18:05:38.345972 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: WARNING keystonemiddleware.auth_token [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:05:38.352515 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: WARNING keystonemiddleware.auth_token [None req-7e31f2a7-2b58-4381-9dd8-66fe6d502159 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:05:38.357925 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d463d509c0 pid: 118161 (default app) Jun 16 18:06:20.160289 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=3 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:06:20.166409 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=3 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:06:20.166409 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=3 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:06:20.166409 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=3 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:06:21.622886 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-786d509e-2b9a-4561-a469-189f53718ae8 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Action: 'create', calling method: .version_select at 0x7f9c3246d790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1013534383", "metadata": {"Type": "work"}}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-786d509e-2b9a-4561-a469-189f53718ae8 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Request method failure captured: Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 122 Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3EcZbAHaghIE82CpIRcemhGe1ZC4rfdnGanWJZ_F8es4X_uQ3lkSA9Rn-_QFk0eZZlK6BepnDM1pKtmIm3YwtvR04NqSLYPSUptFwLf7gmw1RaDW8sro9uprKKCTmBaHpCOtUHL5a3hpEI45VL5i6N-B905jC2gf5KrC_fdjpFA7aE Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 7c39ef5406144d3787a865d9d003c686 Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:06:21.645462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7c39ef5406144d3787a865d9d003c686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 7c39ef5406144d3787a865d9d003c686 Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-VolumesNegativeTest-410073414-project Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: bc0722ec1002496cb0ba7755b08bb492 Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-VolumesNegativeTest-410073414-project Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1013534383", "metadata": {"Type": "work"}}} Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: Jun 16 18:06:21.651903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1013534383', 'metadata': {'Type': 'work'}}}} Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:06:21.652768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:06:21.654076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:06:21.655212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 18:06:21.655212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.655212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-786d509e-2b9a-4561-a469-189f53718ae8 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:06:21.655212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-786d509e-2b9a-4561-a469-189f53718ae8 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.492819 Jun 16 18:06:21.655212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Jun 16 18:06:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1495 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:06:21.660029 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=3 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:06:21.660855 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=3 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:06:21.661778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=3 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:06:21.662864 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=3 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:06:21.890923 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7943aa0d-052e-45ed-aafb-e92c7ec25261 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Action: 'create', calling method: .version_select at 0x7f9c324bc3a0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1711214502", "metadata": {"Type": "work"}}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7943aa0d-052e-45ed-aafb-e92c7ec25261 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Request method failure captured: Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 120 Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3EcZbAHaghIE82CpIRcemhGe1ZC4rfdnGanWJZ_F8es4X_uQ3lkSA9Rn-_QFk0eZZlK6BepnDM1pKtmIm3YwtvR04NqSLYPSUptFwLf7gmw1RaDW8sro9uprKKCTmBaHpCOtUHL5a3hpEI45VL5i6N-B905jC2gf5KrC_fdjpFA7aE Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 7c39ef5406144d3787a865d9d003c686 Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:06:21.895960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7c39ef5406144d3787a865d9d003c686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 7c39ef5406144d3787a865d9d003c686 Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-VolumesNegativeTest-410073414-project Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: bc0722ec1002496cb0ba7755b08bb492 Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-VolumesNegativeTest-410073414-project Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1711214502", "metadata": {"Type": "work"}}} Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: Jun 16 18:06:21.897735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1711214502', 'metadata': {'Type': 'work'}}}} Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi '0' Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:06:21.898738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:06:21.900078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:06:21.901249 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 18:06:21.901249 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.903329 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7943aa0d-052e-45ed-aafb-e92c7ec25261 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:06:21.904833 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7943aa0d-052e-45ed-aafb-e92c7ec25261 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.250327 Jun 16 18:06:21.911147 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 1/2] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Jun 16 18:06:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 258 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:06:21.923267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-32042fad-2440-4967-bef0-a1ac72138ebe tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Action: 'create', calling method: .version_select at 0x7f9c3242fa60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1007718841", "metadata": {"Type": "work"}}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-32042fad-2440-4967-bef0-a1ac72138ebe tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Request method failure captured: Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 119 Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3EcZbAHaghIE82CpIRcemhGe1ZC4rfdnGanWJZ_F8es4X_uQ3lkSA9Rn-_QFk0eZZlK6BepnDM1pKtmIm3YwtvR04NqSLYPSUptFwLf7gmw1RaDW8sro9uprKKCTmBaHpCOtUHL5a3hpEI45VL5i6N-B905jC2gf5KrC_fdjpFA7aE Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 7c39ef5406144d3787a865d9d003c686 Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:06:21.928266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7c39ef5406144d3787a865d9d003c686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 7c39ef5406144d3787a865d9d003c686 Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-VolumesNegativeTest-410073414-project Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: bc0722ec1002496cb0ba7755b08bb492 Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-VolumesNegativeTest-410073414-project Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1007718841", "metadata": {"Type": "work"}}} Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: Jun 16 18:06:21.930140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1007718841', 'metadata': {'Type': 'work'}}}} Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise error Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi '' Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:06:21.931896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 18:06:21.934772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 18:06:21.938105 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 18:06:21.938105 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:21.938105 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-32042fad-2440-4967-bef0-a1ac72138ebe tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:06:21.938105 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-32042fad-2440-4967-bef0-a1ac72138ebe tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018071 Jun 16 18:06:21.941983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 2/3] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Jun 16 18:06:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:06:21.949353 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ba610f01-464c-4f68-9a7f-612612dd3a57 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Calling method '.version_select at 0x7f9c32d1aaf0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:22.966181 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-ba610f01-464c-4f68-9a7f-612612dd3a57 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] HTTP exception thrown: Volume tempest-invalid-961082551 could not be found. Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ba610f01-464c-4f68-9a7f-612612dd3a57 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Request method failure captured: Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-961082551 HTTP/1.1 Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3EcZbAHaghIE82CpIRcemhGe1ZC4rfdnGanWJZ_F8es4X_uQ3lkSA9Rn-_QFk0eZZlK6BepnDM1pKtmIm3YwtvR04NqSLYPSUptFwLf7gmw1RaDW8sro9uprKKCTmBaHpCOtUHL5a3hpEI45VL5i6N-B905jC2gf5KrC_fdjpFA7aE Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 7c39ef5406144d3787a865d9d003c686 Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:06:22.972022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7c39ef5406144d3787a865d9d003c686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 7c39ef5406144d3787a865d9d003c686 Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-VolumesNegativeTest-410073414-project Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: bc0722ec1002496cb0ba7755b08bb492 Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-VolumesNegativeTest-410073414-project Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Volume tempest-invalid-961082551 could not be found. Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': 'tempest-invalid-961082551'} Jun 16 18:06:22.973414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-961082551 could not be found. (HTTP 404) (Request-ID: req-ffbb5ad1-937b-47ed-94b0-f861666457f7) Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:22.974214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:06:22.975448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-961082551 could not be found. Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:06:22.976634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-961082551 could not be found. Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-961082551 could not be found. Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ba610f01-464c-4f68-9a7f-612612dd3a57 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Returning 404 to user: Volume tempest-invalid-961082551 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ba610f01-464c-4f68-9a7f-612612dd3a57 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-961082551" status: 404 len: 98 microversion: 2.1 time: 1.032195 Jun 16 18:06:22.977914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1214 bytes} [Thu Jun 16 18:06:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-961082551 => generated 98 bytes in 1033 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 18:06:22.988359 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c2964819-6183-4029-b1f9-19bfef202261 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006771 Jun 16 18:06:22.989913 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 3/5] 10.222.0.58 () {58 vars in 1139 bytes} [Thu Jun 16 18:06:22 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 18:06:23.001363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-68758ecd-a514-44ec-9a72-d283058f86ab tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005778 Jun 16 18:06:23.010284 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 3/6] 10.222.0.58 () {58 vars in 1136 bytes} [Thu Jun 16 18:06:22 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 18:06:23.020041 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-db8f9076-62bf-49ff-bf5b-514073b47d37 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Calling method '.version_select at 0x7f9c3246d700>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:23.578300 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-db8f9076-62bf-49ff-bf5b-514073b47d37 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] HTTP exception thrown: Volume 38737824-3a2b-4e7e-a38c-6638667bc5be could not be found. Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-db8f9076-62bf-49ff-bf5b-514073b47d37 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Request method failure captured: Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: DELETE /compute/v2.1/os-volumes/38737824-3a2b-4e7e-a38c-6638667bc5be HTTP/1.1 Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3EcZbAHaghIE82CpIRcemhGe1ZC4rfdnGanWJZ_F8es4X_uQ3lkSA9Rn-_QFk0eZZlK6BepnDM1pKtmIm3YwtvR04NqSLYPSUptFwLf7gmw1RaDW8sro9uprKKCTmBaHpCOtUHL5a3hpEI45VL5i6N-B905jC2gf5KrC_fdjpFA7aE Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 7c39ef5406144d3787a865d9d003c686 Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:06:23.583753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7c39ef5406144d3787a865d9d003c686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 7c39ef5406144d3787a865d9d003c686 Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-VolumesNegativeTest-410073414-project Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: bc0722ec1002496cb0ba7755b08bb492 Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-VolumesNegativeTest-410073414-project Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Volume 38737824-3a2b-4e7e-a38c-6638667bc5be could not be found. Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '38737824-3a2b-4e7e-a38c-6638667bc5be'} Jun 16 18:06:23.585315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 38737824-3a2b-4e7e-a38c-6638667bc5be could not be found. (HTTP 404) (Request-ID: req-38f23e31-aff6-4994-8303-9bd5fa10f877) Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:23.586286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:06:23.587978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 38737824-3a2b-4e7e-a38c-6638667bc5be could not be found. Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 18:06:23.589318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 38737824-3a2b-4e7e-a38c-6638667bc5be could not be found. Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 38737824-3a2b-4e7e-a38c-6638667bc5be could not be found. Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-db8f9076-62bf-49ff-bf5b-514073b47d37 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Returning 404 to user: Volume 38737824-3a2b-4e7e-a38c-6638667bc5be could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:06:23.591160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-db8f9076-62bf-49ff-bf5b-514073b47d37 tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/38737824-3a2b-4e7e-a38c-6638667bc5be" status: 404 len: 109 microversion: 2.1 time: 0.573869 Jun 16 18:06:23.592188 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jun 16 18:06:23 2022] DELETE /compute/v2.1/os-volumes/38737824-3a2b-4e7e-a38c-6638667bc5be => generated 109 bytes in 578 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:06:23.601861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-104e08e5-308d-42bc-b1f1-e2a5f310659c tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Calling method '.version_select at 0x7f9c322c4310>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:23.678540 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-104e08e5-308d-42bc-b1f1-e2a5f310659c tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] HTTP exception thrown: Volume 942c5944-4c12-4461-94e3-249d7c4e0d99 could not be found. Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-104e08e5-308d-42bc-b1f1-e2a5f310659c tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Request method failure captured: Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/os-volumes/942c5944-4c12-4461-94e3-249d7c4e0d99 HTTP/1.1 Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3EcZbAHaghIE82CpIRcemhGe1ZC4rfdnGanWJZ_F8es4X_uQ3lkSA9Rn-_QFk0eZZlK6BepnDM1pKtmIm3YwtvR04NqSLYPSUptFwLf7gmw1RaDW8sro9uprKKCTmBaHpCOtUHL5a3hpEI45VL5i6N-B905jC2gf5KrC_fdjpFA7aE Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 7c39ef5406144d3787a865d9d003c686 Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:06:23.681423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7c39ef5406144d3787a865d9d003c686"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7c39ef5406144d3787a865d9d003c686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 7c39ef5406144d3787a865d9d003c686 Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-VolumesNegativeTest-410073414 Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-VolumesNegativeTest-410073414-project Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: bc0722ec1002496cb0ba7755b08bb492 Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-VolumesNegativeTest-410073414-project Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Volume 942c5944-4c12-4461-94e3-249d7c4e0d99 could not be found. Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '942c5944-4c12-4461-94e3-249d7c4e0d99'} Jun 16 18:06:23.683017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 942c5944-4c12-4461-94e3-249d7c4e0d99 could not be found. (HTTP 404) (Request-ID: req-0c546ff2-7d3d-4a17-bc21-2321f34103e4) Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:23.690209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:06:23.692099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 942c5944-4c12-4461-94e3-249d7c4e0d99 could not be found. Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:06:23.693334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 942c5944-4c12-4461-94e3-249d7c4e0d99 could not be found. Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 942c5944-4c12-4461-94e3-249d7c4e0d99 could not be found. Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-104e08e5-308d-42bc-b1f1-e2a5f310659c tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] Returning 404 to user: Volume 942c5944-4c12-4461-94e3-249d7c4e0d99 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-104e08e5-308d-42bc-b1f1-e2a5f310659c tempest-VolumesNegativeTest-410073414 tempest-VolumesNegativeTest-410073414-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/942c5944-4c12-4461-94e3-249d7c4e0d99" status: 404 len: 109 microversion: 2.1 time: 0.084926 Jun 16 18:06:23.694775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:06:23 2022] GET /compute/v2.1/os-volumes/942c5944-4c12-4461-94e3-249d7c4e0d99 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:06:26.062302 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c6e8b1c9-1d08-4a0e-9eca-51c69e329a9a tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] Calling method '.version_select at 0x7f9c32d1a8b0>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:26.142860 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c6e8b1c9-1d08-4a0e-9eca-51c69e329a9a tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/0055bf5f-c8ae-4562-bd8a-f7ededec3b54" status: 200 len: 351 microversion: 2.1 time: 0.091144 Jun 16 18:06:26.143476 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 5/9] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:06:26 2022] GET /compute/v2.1/os-volumes/0055bf5f-c8ae-4562-bd8a-f7ededec3b54 => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:06:29.405789 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-067207ae-75b1-4d20-8369-bd26a68c1f8e tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] Calling method '.version_select at 0x7f9c322c45e0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:29.537613 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-067207ae-75b1-4d20-8369-bd26a68c1f8e tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1bc5a1a3-d05b-4456-b3d1-66a6ef81a83a" status: 200 len: 351 microversion: 2.1 time: 0.132978 Jun 16 18:06:29.537613 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 5/10] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:06:29 2022] GET /compute/v2.1/os-volumes/1bc5a1a3-d05b-4456-b3d1-66a6ef81a83a => generated 351 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:06:32.853656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-75f5a1b6-5018-4a53-ad34-def84d24c2cb tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] Calling method '.version_select at 0x7f9c322c98b0>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:32.961407 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-75f5a1b6-5018-4a53-ad34-def84d24c2cb tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/fe63f4b8-c713-49e9-906e-0edfc2f23948" status: 200 len: 350 microversion: 2.1 time: 0.119467 Jun 16 18:06:32.961407 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 6/11] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:06:32 2022] GET /compute/v2.1/os-volumes/fe63f4b8-c713-49e9-906e-0edfc2f23948 => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:06:32.976213 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-13af1d71-90b8-49c9-95d9-63be1e51fadf tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] Calling method '.version_select at 0x7f9c322c4820>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:33.122669 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-13af1d71-90b8-49c9-95d9-63be1e51fadf tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.154059 Jun 16 18:06:33.125423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1133 bytes} [Thu Jun 16 18:06:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:33.147775 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dfedf1d5-9696-438a-83e6-a3798aeb31b9 tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] Calling method '.version_select at 0x7f9c322c9ee0>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:33.424655 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-dfedf1d5-9696-438a-83e6-a3798aeb31b9 tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.288970 Jun 16 18:06:33.425205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1148 bytes} [Thu Jun 16 18:06:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:06:33.439756 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-fc1a9c86-29e3-43ad-b6f7-a0a735a2c264 tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] Calling method '.version_select at 0x7f9c322c4ca0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:33.627162 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-fc1a9c86-29e3-43ad-b6f7-a0a735a2c264 tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.191375 Jun 16 18:06:33.635625 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 7/14] 10.222.0.58 () {58 vars in 1133 bytes} [Thu Jun 16 18:06:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:33.641525 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-40b0fa3a-837a-4ff6-a185-6799ef2205eb tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] Calling method '.version_select at 0x7f9c322cdb80>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:33.805229 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-40b0fa3a-837a-4ff6-a185-6799ef2205eb tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.169326 Jun 16 18:06:33.805999 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 8/15] 10.222.0.58 () {58 vars in 1166 bytes} [Thu Jun 16 18:06:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:06:33.823548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3d63354e-fa08-4783-a5aa-6bb3dc83e4f2 tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] Calling method '.version_select at 0x7f9c3233f820>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:33.980659 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3d63354e-fa08-4783-a5aa-6bb3dc83e4f2 tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.165919 Jun 16 18:06:33.981229 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1169 bytes} [Thu Jun 16 18:06:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:06:33.996062 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c83ae10c-a392-4137-969a-85b0335d3298 tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] Calling method '.version_select at 0x7f9c322cd820>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:34.137358 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c83ae10c-a392-4137-969a-85b0335d3298 tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.145472 Jun 16 18:06:34.148964 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 9/17] 10.222.0.58 () {58 vars in 1154 bytes} [Thu Jun 16 18:06:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:34.150548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-40e44903-ec7a-4410-ab6e-4c7631738857 tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] Calling method '.version_select at 0x7f9c322d0550>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:34.274369 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-40e44903-ec7a-4410-ab6e-4c7631738857 tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.128133 Jun 16 18:06:34.292427 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-29d171e6-92a1-4fc6-af6e-3da676c26ede tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] Calling method '.version_select at 0x7f9c322c9e50>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:34.292958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 9/18] 10.222.0.58 () {58 vars in 1187 bytes} [Thu Jun 16 18:06:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:06:34.420710 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-29d171e6-92a1-4fc6-af6e-3da676c26ede tempest-VolumesTestJSON-1501645734 tempest-VolumesTestJSON-1501645734-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.131495 Jun 16 18:06:34.421279 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 10/19] 10.222.0.58 () {58 vars in 1154 bytes} [Thu Jun 16 18:06:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:35.514529 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1650115112", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:06:35.711764 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] validate_networks() for [('a03d1a55-b841-416c-8968-4e0f58b34cf4', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:06:38.247190 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:06:38.247871 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:06:38.248468 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:06:38.248885 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:06:38.249670 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:06:38.323931 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:38.324637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:38.330148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:38.334216 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:38.470772 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Getting quotas for project b566750533af4d0d96a3d0e0ffbc45ed. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:06:38.491382 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Getting quotas for user 70d6f15465b84182a28d96d1808a9660 and project b566750533af4d0d96a3d0e0ffbc45ed. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:06:38.533708 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:06:38.539299 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:06:38.944874 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5423c377-ba9e-4330-9ecc-706a0f1ac4b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.722208 Jun 16 18:06:38.945864 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 10/20] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:06:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 3724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:06:38.960094 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-05a353d3-6532-4672-8b4a-ec8588628324 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:38.960927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-05a353d3-6532-4672-8b4a-ec8588628324 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:39.275009 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-05a353d3-6532-4672-8b4a-ec8588628324 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:39.302774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-05a353d3-6532-4672-8b4a-ec8588628324 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1222 microversion: 2.1 time: 0.347257 Jun 16 18:06:39.322797 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 11/21] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:38 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1222 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:39.715576 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-44641218", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:06:39.853233 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] validate_networks() for [('a03d1a55-b841-416c-8968-4e0f58b34cf4', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:06:41.908040 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:06:41.909258 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:06:41.909984 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:06:41.910612 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:06:41.911239 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:06:41.934655 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:41.934655 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:41.934841 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:41.942915 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:42.006525 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Getting quotas for project b566750533af4d0d96a3d0e0ffbc45ed. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:06:42.031703 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Getting quotas for user 70d6f15465b84182a28d96d1808a9660 and project b566750533af4d0d96a3d0e0ffbc45ed. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:06:42.073409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:06:42.078201 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:06:42.301296 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a418c1ea-b354-48bd-a5e0-9592e478c187 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.591612 Jun 16 18:06:42.302467 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 11/22] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:06:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 2594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:06:42.321922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-79d8d10b-7870-4a46-8614-491cd869f008 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:42.323683 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-79d8d10b-7870-4a46-8614-491cd869f008 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:42.514826 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-79d8d10b-7870-4a46-8614-491cd869f008 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:42.535209 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-79d8d10b-7870-4a46-8614-491cd869f008 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1220 microversion: 2.1 time: 0.218821 Jun 16 18:06:42.559131 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 12/23] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:42 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1220 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:42.988815 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1508356469", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "networks": [{"uuid": "a2d94986-9023-49e2-9a1f-9258b1524297"}]}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:06:43.097761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] validate_networks() for [('a2d94986-9023-49e2-9a1f-9258b1524297', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:06:43.577278 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5668ce69-fa4b-41e6-9684-7dd7d68c3511 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:43.578722 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5668ce69-fa4b-41e6-9684-7dd7d68c3511 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:43.893217 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5668ce69-fa4b-41e6-9684-7dd7d68c3511 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:43.918103 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5668ce69-fa4b-41e6-9684-7dd7d68c3511 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1220 microversion: 2.1 time: 0.345639 Jun 16 18:06:43.919815 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 13/24] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:43 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1220 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:06:44.182391 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:06:44.183460 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:06:44.184130 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:06:44.192515 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:06:44.194129 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:06:44.219018 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:44.221933 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:44.227668 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:44.232889 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:44.308731 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Getting quotas for project 285d8bae36f34e6a80a3982ebb097ea3. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:06:44.321164 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Getting quotas for user 9eac1fb288764b74baf30892237b3cdc and project 285d8bae36f34e6a80a3982ebb097ea3. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:06:44.362584 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:06:44.369073 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:06:44.682869 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-36dd3414-cb6a-4baa-a1a2-f461321e8fff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Action: 'create', calling method: .version_select at 0x7f9c322cdd30>, body: {"keypair": {"name": "tempest-keypair-2109035206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/HHAGdj1cqGIRTRZzirbk8HujbKTxonNiwwYcLVzOkRu0MCxgaMfDHsAEoJ3Q6YiGgRWoolb4N9fSDQrMaiCKe1B50OpmAiYRM4ItpimRmIIP8jN20PwtbYer6dgaPjQ=="}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:06:44.712973 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d6dedd4c-a443-4e39-a0a8-6f160a654bbc tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.347593 Jun 16 18:06:44.717009 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 12/25] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:06:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:06:44.728075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-62b34993-36f8-46bd-bc64-dcd212a952b4 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:44.731469 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-62b34993-36f8-46bd-bc64-dcd212a952b4 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:44.780151 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-36dd3414-cb6a-4baa-a1a2-f461321e8fff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Getting quotas for project 11089493792047939c9f45f632a0ce05. Resources: {'key_pairs'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:06:44.811568 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-36dd3414-cb6a-4baa-a1a2-f461321e8fff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Getting quotas for user 30ac12728e8f4ec9af534612030d75eb and project 11089493792047939c9f45f632a0ce05. Resources: {'key_pairs'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:06:44.975458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-36dd3414-cb6a-4baa-a1a2-f461321e8fff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.767061 Jun 16 18:06:44.976860 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 14/26] 10.222.0.58 () {62 vars in 1199 bytes} [Thu Jun 16 18:06:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 769 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:06:44.986019 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2940a8d1-3b4a-4fbf-a3f5-f34b158d740b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:44.986019 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2940a8d1-3b4a-4fbf-a3f5-f34b158d740b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:44.993338 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-62b34993-36f8-46bd-bc64-dcd212a952b4 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:45.010617 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2940a8d1-3b4a-4fbf-a3f5-f34b158d740b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:45.016113 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2940a8d1-3b4a-4fbf-a3f5-f34b158d740b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:45.022084 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2940a8d1-3b4a-4fbf-a3f5-f34b158d740b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:45.022695 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2940a8d1-3b4a-4fbf-a3f5-f34b158d740b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:45.034794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-62b34993-36f8-46bd-bc64-dcd212a952b4 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1215 microversion: 2.1 time: 0.312585 Jun 16 18:06:45.055022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 13/27] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:44 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1215 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:45.539066 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2940a8d1-3b4a-4fbf-a3f5-f34b158d740b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:45.580029 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2940a8d1-3b4a-4fbf-a3f5-f34b158d740b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1224 microversion: 2.1 time: 0.601477 Jun 16 18:06:45.600604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 15/28] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:44 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1224 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:46.057794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-34e52dcc-50da-4316-ab84-a2363003d73e tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:46.058825 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-34e52dcc-50da-4316-ab84-a2363003d73e tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:46.615708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-347fcf1e-3998-4ce4-9fc1-33c3f9bed909 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:46.615708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-347fcf1e-3998-4ce4-9fc1-33c3f9bed909 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:46.628081 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-347fcf1e-3998-4ce4-9fc1-33c3f9bed909 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:46.628976 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-347fcf1e-3998-4ce4-9fc1-33c3f9bed909 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:46.645780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-347fcf1e-3998-4ce4-9fc1-33c3f9bed909 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:46.647620 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-347fcf1e-3998-4ce4-9fc1-33c3f9bed909 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:46.813927 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-34e52dcc-50da-4316-ab84-a2363003d73e tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:46.829175 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-34e52dcc-50da-4316-ab84-a2363003d73e tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1215 microversion: 2.1 time: 0.777302 Jun 16 18:06:46.831956 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 14/29] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:46 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1215 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:47.294739 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-347fcf1e-3998-4ce4-9fc1-33c3f9bed909 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:47.304103 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-347fcf1e-3998-4ce4-9fc1-33c3f9bed909 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1272 microversion: 2.1 time: 0.704236 Jun 16 18:06:47.312105 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 16/30] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:46 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1272 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:48.003083 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e4a23829-b503-4dd5-bd57-9f1738c23d28 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Action: 'create', calling method: .version_select at 0x7f9c31184280>, body: {"keypair": {"name": "tempest-keypair-885876849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODrZ0nOMlu+V7ufoD9s+ZVnVsqrqLPzVcYf0Nob4BuwvfioER9BVHarVJtFOd1k9FBE9ikQ7pQL5/l4zFtWnTNWJu59nNpJC17kbSZicPfvIn4AZKhOZJogzGHunMFKug=="}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:06:48.069605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-e4a23829-b503-4dd5-bd57-9f1738c23d28 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Getting quotas for project 14b0926322074e2da25ddaae611d89d4. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:06:48.076930 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-e4a23829-b503-4dd5-bd57-9f1738c23d28 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Getting quotas for user 712089cbbf9a424fa5d4412ced2cdc58 and project 14b0926322074e2da25ddaae611d89d4. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:06:48.283894 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e4a23829-b503-4dd5-bd57-9f1738c23d28 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.246288 Jun 16 18:06:48.285302 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 15/31] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jun 16 18:06:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:06:48.293411 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-522a4806-662b-4388-8a38-049748124c66 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:48.294398 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-522a4806-662b-4388-8a38-049748124c66 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:48.307390 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-522a4806-662b-4388-8a38-049748124c66 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:48.308410 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-522a4806-662b-4388-8a38-049748124c66 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:48.309648 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-522a4806-662b-4388-8a38-049748124c66 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:48.310482 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-522a4806-662b-4388-8a38-049748124c66 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:48.535170 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-eb718fc6-26bc-4fff-b809-f7d14c652c0e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: .version_select at 0x7f9c3192d8b0>, body: {"keypair": {"name": "tempest-keypair-1698248313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjG1xi3YbhF9uvWe+9CAro7lu9uSGSui0u7URdR0w9RR0gg7CPyq+RGDD9GWvlZz7iju0OJClOMxSIO3F6gwgCqrMtrjlK1J+uCGDs8WZY+5PBE5S7eUsjrD57deAOAnA=="}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:06:48.631976 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-eb718fc6-26bc-4fff-b809-f7d14c652c0e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'key_pairs'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:06:48.652157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-eb718fc6-26bc-4fff-b809-f7d14c652c0e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for user 8498989e673d445dbc70aa9df55f391b and project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'key_pairs'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:06:48.754133 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-522a4806-662b-4388-8a38-049748124c66 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:48.795234 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-eb718fc6-26bc-4fff-b809-f7d14c652c0e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.033298 Jun 16 18:06:48.795234 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 17/32] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jun 16 18:06:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:06:48.807043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-522a4806-662b-4388-8a38-049748124c66 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1267 microversion: 2.1 time: 0.520061 Jun 16 18:06:48.811696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 16/33] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:48 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1267 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:48.811906 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1916f065-489b-4cff-9667-5a850f93a35d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:48.813326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1916f065-489b-4cff-9667-5a850f93a35d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:48.854517 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1916f065-489b-4cff-9667-5a850f93a35d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:48.856930 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1916f065-489b-4cff-9667-5a850f93a35d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:48.860044 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1916f065-489b-4cff-9667-5a850f93a35d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:48.861309 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1916f065-489b-4cff-9667-5a850f93a35d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:49.213759 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1916f065-489b-4cff-9667-5a850f93a35d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:49.230091 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1916f065-489b-4cff-9667-5a850f93a35d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1278 microversion: 2.1 time: 0.431960 Jun 16 18:06:49.231321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 18/34] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:48 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1278 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:49.833343 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-27bec34b-c4ae-445c-9499-7f44075e5e05 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:49.834158 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-27bec34b-c4ae-445c-9499-7f44075e5e05 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:49.846989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27bec34b-c4ae-445c-9499-7f44075e5e05 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:49.847480 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27bec34b-c4ae-445c-9499-7f44075e5e05 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:49.848290 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27bec34b-c4ae-445c-9499-7f44075e5e05 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:49.848735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27bec34b-c4ae-445c-9499-7f44075e5e05 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:50.132304 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-27bec34b-c4ae-445c-9499-7f44075e5e05 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:50.161585 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-27bec34b-c4ae-445c-9499-7f44075e5e05 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1273 microversion: 2.1 time: 0.332323 Jun 16 18:06:50.162194 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 17/35] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:49 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1273 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:50.251207 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6b344628-9a12-47d7-aacb-fd38302b154b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:50.252067 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6b344628-9a12-47d7-aacb-fd38302b154b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:50.266191 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6b344628-9a12-47d7-aacb-fd38302b154b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:50.272214 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6b344628-9a12-47d7-aacb-fd38302b154b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:50.273141 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6b344628-9a12-47d7-aacb-fd38302b154b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:50.273753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6b344628-9a12-47d7-aacb-fd38302b154b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:50.446600 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6b344628-9a12-47d7-aacb-fd38302b154b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:50.471737 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6b344628-9a12-47d7-aacb-fd38302b154b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1278 microversion: 2.1 time: 0.225306 Jun 16 18:06:50.501221 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 19/36] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:50 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1278 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:51.201113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3fe3b8a4-472a-49cf-b93f-1d15919af9b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:51.201782 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3fe3b8a4-472a-49cf-b93f-1d15919af9b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:51.237064 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3fe3b8a4-472a-49cf-b93f-1d15919af9b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:51.237775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3fe3b8a4-472a-49cf-b93f-1d15919af9b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:51.243501 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3fe3b8a4-472a-49cf-b93f-1d15919af9b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:51.244125 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3fe3b8a4-472a-49cf-b93f-1d15919af9b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:51.509629 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f3950608-2da7-4966-a6ab-274ef5bf722f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:51.522623 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f3950608-2da7-4966-a6ab-274ef5bf722f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:51.539094 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3950608-2da7-4966-a6ab-274ef5bf722f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:51.539616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3950608-2da7-4966-a6ab-274ef5bf722f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:51.548685 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3950608-2da7-4966-a6ab-274ef5bf722f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:51.549380 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3950608-2da7-4966-a6ab-274ef5bf722f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:51.778721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3fe3b8a4-472a-49cf-b93f-1d15919af9b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:51.790587 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3fe3b8a4-472a-49cf-b93f-1d15919af9b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1273 microversion: 2.1 time: 0.595268 Jun 16 18:06:51.800154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 18/37] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:51 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1273 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:51.953956 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f3950608-2da7-4966-a6ab-274ef5bf722f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:51.967150 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f3950608-2da7-4966-a6ab-274ef5bf722f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1278 microversion: 2.1 time: 0.465308 Jun 16 18:06:51.974973 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 20/38] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:51 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1278 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:06:52.828005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-96d700fa-9ee8-4acc-81a7-855d2fceea45 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:52.829231 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-96d700fa-9ee8-4acc-81a7-855d2fceea45 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:52.851289 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96d700fa-9ee8-4acc-81a7-855d2fceea45 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:52.853040 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96d700fa-9ee8-4acc-81a7-855d2fceea45 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:52.856738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96d700fa-9ee8-4acc-81a7-855d2fceea45 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:52.857546 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96d700fa-9ee8-4acc-81a7-855d2fceea45 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:52.993260 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0ab87863-858a-4b3d-82c3-c94222eab099 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:52.994570 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0ab87863-858a-4b3d-82c3-c94222eab099 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:53.031439 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ab87863-858a-4b3d-82c3-c94222eab099 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:53.037743 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ab87863-858a-4b3d-82c3-c94222eab099 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:53.038967 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ab87863-858a-4b3d-82c3-c94222eab099 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:53.044317 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ab87863-858a-4b3d-82c3-c94222eab099 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:53.480597 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-96d700fa-9ee8-4acc-81a7-855d2fceea45 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:53.490133 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-96d700fa-9ee8-4acc-81a7-855d2fceea45 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1273 microversion: 2.1 time: 0.667306 Jun 16 18:06:53.491106 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 19/39] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:52 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1273 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:54.140127 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0ab87863-858a-4b3d-82c3-c94222eab099 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:54.158118 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0ab87863-858a-4b3d-82c3-c94222eab099 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 1.168005 Jun 16 18:06:54.171476 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 21/40] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:52 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:54.542921 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-91086a0e-3b30-45e1-a093-14904e7ea181 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:54.543761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-91086a0e-3b30-45e1-a093-14904e7ea181 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:54.560712 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=6 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:06:54.568137 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-91086a0e-3b30-45e1-a093-14904e7ea181 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:54.568593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-91086a0e-3b30-45e1-a093-14904e7ea181 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:54.569566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-91086a0e-3b30-45e1-a093-14904e7ea181 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:54.570166 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-91086a0e-3b30-45e1-a093-14904e7ea181 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:55.178052 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-92fddc45-7842-4c31-9495-d1a2d2b52a31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:55.178828 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-92fddc45-7842-4c31-9495-d1a2d2b52a31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:55.195398 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-92fddc45-7842-4c31-9495-d1a2d2b52a31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:55.203295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-92fddc45-7842-4c31-9495-d1a2d2b52a31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:55.204270 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-92fddc45-7842-4c31-9495-d1a2d2b52a31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:55.204733 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-92fddc45-7842-4c31-9495-d1a2d2b52a31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:56.681644 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-92fddc45-7842-4c31-9495-d1a2d2b52a31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:56.713680 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-91086a0e-3b30-45e1-a093-14904e7ea181 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:56.736035 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-91086a0e-3b30-45e1-a093-14904e7ea181 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 2.193221 Jun 16 18:06:56.737658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-92fddc45-7842-4c31-9495-d1a2d2b52a31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 1.563347 Jun 16 18:06:56.744311 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 22/41] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:55 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:06:56.751748 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 20/42] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:54 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:57.184394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-682b4123-72db-4ffd-a1cd-db408a7949a0 req-f4abdb5b-08a4-4f80-b9cc-7a36e49f530e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d859d92-dab1-47f8-85ba-1e86413ceec9", "tag": "cb3429ba-4c67-4253-ae49-1e5ad7f17023"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:06:57.227263 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-682b4123-72db-4ffd-a1cd-db408a7949a0 req-f4abdb5b-08a4-4f80-b9cc-7a36e49f530e service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:57.231078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-682b4123-72db-4ffd-a1cd-db408a7949a0 req-f4abdb5b-08a4-4f80-b9cc-7a36e49f530e service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:57.330618 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-682b4123-72db-4ffd-a1cd-db408a7949a0 req-f4abdb5b-08a4-4f80-b9cc-7a36e49f530e service nova] Creating event network-changed:cb3429ba-4c67-4253-ae49-1e5ad7f17023 for instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 on hv-cinder-83754 Jun 16 18:06:57.332066 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-682b4123-72db-4ffd-a1cd-db408a7949a0 req-f4abdb5b-08a4-4f80-b9cc-7a36e49f530e service nova] Acquired lock "compute-rpcapi-router" {{(pid=118162) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:06:57.335620 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-17d003ec-229e-4af8-b1ff-ab1479b30448 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:57.344063 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-17d003ec-229e-4af8-b1ff-ab1479b30448 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:57.345390 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-17d003ec-229e-4af8-b1ff-ab1479b30448 None None] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:57.345851 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-17d003ec-229e-4af8-b1ff-ab1479b30448 None None] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:57.375388 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.compute.rpcapi [None req-17d003ec-229e-4af8-b1ff-ab1479b30448 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 18:06:57.378722 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-17d003ec-229e-4af8-b1ff-ab1479b30448 None None] Releasing lock "compute-rpcapi-router" {{(pid=118162) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:06:57.447346 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-17d003ec-229e-4af8-b1ff-ab1479b30448 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.417561 Jun 16 18:06:57.447346 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 23/43] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:06:57.753661 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ad02710d-ae74-4e34-9596-3d86b1a297d0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:57.754325 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ad02710d-ae74-4e34-9596-3d86b1a297d0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:57.765042 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a1cd8054-6000-4aa2-80e7-6f34676f89fb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:57.765762 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a1cd8054-6000-4aa2-80e7-6f34676f89fb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:06:57.767446 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ad02710d-ae74-4e34-9596-3d86b1a297d0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:57.768136 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ad02710d-ae74-4e34-9596-3d86b1a297d0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:57.770048 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ad02710d-ae74-4e34-9596-3d86b1a297d0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:57.775108 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ad02710d-ae74-4e34-9596-3d86b1a297d0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:57.793620 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a1cd8054-6000-4aa2-80e7-6f34676f89fb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:57.794538 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a1cd8054-6000-4aa2-80e7-6f34676f89fb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:57.818534 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a1cd8054-6000-4aa2-80e7-6f34676f89fb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:06:57.820126 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a1cd8054-6000-4aa2-80e7-6f34676f89fb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:06:58.094342 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=26 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:06:58.680780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=14 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:06:58.773014 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ad02710d-ae74-4e34-9596-3d86b1a297d0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:58.795460 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ad02710d-ae74-4e34-9596-3d86b1a297d0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 1.045533 Jun 16 18:06:58.801079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 21/44] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:57 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:06:58.822618 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-60444936", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96883365-6ff9-48c2-aa63-6859af6f797f"}], "security_groups": [{"name": "tempest-securitygroup--2132781915"}], "key_name": "tempest-keypair-2109035206", "user_data": "}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:06:59.546442 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] validate_networks() for [('96883365-6ff9-48c2-aa63-6859af6f797f', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:06:59.724474 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a1cd8054-6000-4aa2-80e7-6f34676f89fb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:06:59.733953 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a1cd8054-6000-4aa2-80e7-6f34676f89fb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 1.975518 Jun 16 18:06:59.744047 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 24/45] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:57 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:06:59.998699 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-75e461f2-c39d-4e20-b201-3b970ab5bcb2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:06:59.999559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-75e461f2-c39d-4e20-b201-3b970ab5bcb2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:00.010717 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-75e461f2-c39d-4e20-b201-3b970ab5bcb2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:00.011186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-75e461f2-c39d-4e20-b201-3b970ab5bcb2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:00.012881 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-75e461f2-c39d-4e20-b201-3b970ab5bcb2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:00.013443 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-75e461f2-c39d-4e20-b201-3b970ab5bcb2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:00.810322 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-75e461f2-c39d-4e20-b201-3b970ab5bcb2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:00.852951 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-75e461f2-c39d-4e20-b201-3b970ab5bcb2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.857627 Jun 16 18:07:00.867185 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 25/46] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:06:59 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:00.873555 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6f459973-7e6b-43a2-bd23-1d5f6e8193d3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:00.874517 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6f459973-7e6b-43a2-bd23-1d5f6e8193d3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:00.917118 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6f459973-7e6b-43a2-bd23-1d5f6e8193d3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:00.935949 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6f459973-7e6b-43a2-bd23-1d5f6e8193d3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:00.937131 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6f459973-7e6b-43a2-bd23-1d5f6e8193d3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:00.951566 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6f459973-7e6b-43a2-bd23-1d5f6e8193d3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:01.475082 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:07:01.476449 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:07:01.477331 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:07:01.478034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:07:01.478858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:07:01.502505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:01.505981 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:01.506211 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:01.507123 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:01.565912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Getting quotas for project 11089493792047939c9f45f632a0ce05. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:07:01.574835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Getting quotas for user 30ac12728e8f4ec9af534612030d75eb and project 11089493792047939c9f45f632a0ce05. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:07:01.624209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:07:01.630368 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:07:01.639577 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6f459973-7e6b-43a2-bd23-1d5f6e8193d3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:01.685631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6f459973-7e6b-43a2-bd23-1d5f6e8193d3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.813334 Jun 16 18:07:01.691612 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 26/47] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:00 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:01.720843 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-776469600", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f17e2725-a961-43b0-9ec4-3a8964c308ae"}], "security_groups": [{"name": "tempest-securitygroup--1223701170"}], "key_name": "tempest-keypair-1698248313", "user_data": "}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:01.908443 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e956af21-0ace-4488-880b-960120f1e04a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.106134 Jun 16 18:07:01.910784 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 22/48] 10.222.0.58 () {62 vars in 1187 bytes} [Thu Jun 16 18:06:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 3109 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:07:02.216408 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.network.neutron [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] validate_networks() for [('f17e2725-a961-43b0-9ec4-3a8964c308ae', None, None, None, None, None)] {{(pid=118162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:07:02.238949 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-205bb1df-320b-4825-85e9-39cc4bf28a41 req-f2d38121-e90a-48de-967a-adfbad3a9576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91383053-09e9-4294-86b1-ba106512b82f", "tag": "8f397e6e-f2ca-4cbf-a4ea-14613d40280b"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:02.274603 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:02.283694 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-205bb1df-320b-4825-85e9-39cc4bf28a41 req-f2d38121-e90a-48de-967a-adfbad3a9576 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:02.284150 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-205bb1df-320b-4825-85e9-39cc4bf28a41 req-f2d38121-e90a-48de-967a-adfbad3a9576 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:02.318097 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-205bb1df-320b-4825-85e9-39cc4bf28a41 req-f2d38121-e90a-48de-967a-adfbad3a9576 service nova] Creating event network-changed:8f397e6e-f2ca-4cbf-a4ea-14613d40280b for instance 91383053-09e9-4294-86b1-ba106512b82f on hv-cinder-83754 Jun 16 18:07:02.318879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-205bb1df-320b-4825-85e9-39cc4bf28a41 req-f2d38121-e90a-48de-967a-adfbad3a9576 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118161) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:07:02.320614 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bc9c38cd-485a-466a-825f-5843bfe44a40 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:02.321238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bc9c38cd-485a-466a-825f-5843bfe44a40 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:02.322230 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bc9c38cd-485a-466a-825f-5843bfe44a40 None None] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:02.322824 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bc9c38cd-485a-466a-825f-5843bfe44a40 None None] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:02.335038 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.compute.rpcapi [None req-bc9c38cd-485a-466a-825f-5843bfe44a40 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 18:07:02.336787 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bc9c38cd-485a-466a-825f-5843bfe44a40 None None] Releasing lock "compute-rpcapi-router" {{(pid=118161) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:07:02.366621 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-bc9c38cd-485a-466a-825f-5843bfe44a40 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.453115 Jun 16 18:07:02.368026 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 23/49] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:02.374971 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-aff73250-d48e-4105-98d2-076097d20f9d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:02.375756 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-aff73250-d48e-4105-98d2-076097d20f9d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:02.390699 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aff73250-d48e-4105-98d2-076097d20f9d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:02.391635 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aff73250-d48e-4105-98d2-076097d20f9d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:02.393160 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aff73250-d48e-4105-98d2-076097d20f9d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:02.394036 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aff73250-d48e-4105-98d2-076097d20f9d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:02.948264 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:02.971400 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-aff73250-d48e-4105-98d2-076097d20f9d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:02.998515 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-aff73250-d48e-4105-98d2-076097d20f9d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.626419 Jun 16 18:07:03.006520 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 24/50] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:02 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:03.025085 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-55acbcc5-6acc-4287-a4d2-6804d00acd7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:03.028328 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-55acbcc5-6acc-4287-a4d2-6804d00acd7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:03.203239 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-55acbcc5-6acc-4287-a4d2-6804d00acd7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:03.214368 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-55acbcc5-6acc-4287-a4d2-6804d00acd7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:03.232108 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-55acbcc5-6acc-4287-a4d2-6804d00acd7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:03.236762 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-55acbcc5-6acc-4287-a4d2-6804d00acd7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1280 microversion: 2.20 time: 0.222616 Jun 16 18:07:03.243030 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:03 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1280 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:03.269390 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-874221953", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb31acf5-629a-4efc-bb11-e4f0dbd882be"}], "security_groups": [{"name": "tempest-securitygroup--423123271"}], "key_name": "tempest-keypair-885876849", "user_data": "}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:03.952395 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] validate_networks() for [('bb31acf5-629a-4efc-bb11-e4f0dbd882be', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:07:04.216061 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Flavor limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:07:04.216061 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Image limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:07:04.216061 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Flavor pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:07:04.216061 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Image pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:07:04.216061 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:07:04.216828 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:04.216828 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:04.216828 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:04.216828 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:04.222106 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:07:04.226059 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for user 8498989e673d445dbc70aa9df55f391b and project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:07:04.242736 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Going to run 1 instances... {{(pid=118162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:07:04.245565 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:07:04.478635 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:07:04.479148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:07:04.479550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:07:04.479959 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:07:04.480367 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:07:04.495809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:04.496957 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:04.497763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:04.498240 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:04.504118 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=55 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:04.518210 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Getting quotas for project 14b0926322074e2da25ddaae611d89d4. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:07:04.522943 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Getting quotas for user 712089cbbf9a424fa5d4412ced2cdc58 and project 14b0926322074e2da25ddaae611d89d4. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:07:04.534722 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:07:04.537027 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:07:04.640300 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3d3ffa1b-f9c3-4df3-bfcc-12c0e9cd67c1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.947503 Jun 16 18:07:04.649419 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:07:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 2950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:07:04.654617 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4b5b668f-8128-4b64-a4f4-8273801ea407 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:04.654903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4b5b668f-8128-4b64-a4f4-8273801ea407 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:04.664169 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4b5b668f-8128-4b64-a4f4-8273801ea407 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:04.664910 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4b5b668f-8128-4b64-a4f4-8273801ea407 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:04.666464 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4b5b668f-8128-4b64-a4f4-8273801ea407 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:04.666464 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4b5b668f-8128-4b64-a4f4-8273801ea407 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:04.830986 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4b5b668f-8128-4b64-a4f4-8273801ea407 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:04.838750 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4b5b668f-8128-4b64-a4f4-8273801ea407 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.195028 Jun 16 18:07:04.843527 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 28/53] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:04 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:04.844260 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-fe767279-5024-4556-a421-226caacfa1ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:04.845039 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-fe767279-5024-4556-a421-226caacfa1ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:04.845500 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-77b80ae2-74e3-4b08-a8b3-46635eb5f65c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.597107 Jun 16 18:07:04.851310 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 26/54] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:07:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:07:04.857330 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a911feb4-a3b3-4d2d-9471-2e9ed1869502 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:04.858141 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a911feb4-a3b3-4d2d-9471-2e9ed1869502 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:04.860784 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fe767279-5024-4556-a421-226caacfa1ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:04.862224 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fe767279-5024-4556-a421-226caacfa1ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:04.865934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a911feb4-a3b3-4d2d-9471-2e9ed1869502 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:04.866069 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fe767279-5024-4556-a421-226caacfa1ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:04.866400 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a911feb4-a3b3-4d2d-9471-2e9ed1869502 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:04.866978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fe767279-5024-4556-a421-226caacfa1ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:04.867169 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a911feb4-a3b3-4d2d-9471-2e9ed1869502 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:04.867667 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a911feb4-a3b3-4d2d-9471-2e9ed1869502 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:04.974547 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a911feb4-a3b3-4d2d-9471-2e9ed1869502 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:04.984855 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a911feb4-a3b3-4d2d-9471-2e9ed1869502 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:04.990741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a911feb4-a3b3-4d2d-9471-2e9ed1869502 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:04.994740 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a911feb4-a3b3-4d2d-9471-2e9ed1869502 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1284 microversion: 2.20 time: 0.141206 Jun 16 18:07:04.996724 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 27/55] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:04 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:05.008958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-a02f35be-31aa-471f-944f-d71c37dcc353 req-cd2c3d42-97e5-4813-9b0d-946ba65ad238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e8a4704-5fc6-45e0-901c-a972411b4d0c", "tag": "4dd40206-bc4d-4054-80c9-ae713a416d7a"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:05.020311 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-a02f35be-31aa-471f-944f-d71c37dcc353 req-cd2c3d42-97e5-4813-9b0d-946ba65ad238 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:05.021013 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-a02f35be-31aa-471f-944f-d71c37dcc353 req-cd2c3d42-97e5-4813-9b0d-946ba65ad238 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:05.036922 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-a02f35be-31aa-471f-944f-d71c37dcc353 req-cd2c3d42-97e5-4813-9b0d-946ba65ad238 service nova] Creating event network-changed:4dd40206-bc4d-4054-80c9-ae713a416d7a for instance 5e8a4704-5fc6-45e0-901c-a972411b4d0c on hv-cinder-83754 Jun 16 18:07:05.043025 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-a02f35be-31aa-471f-944f-d71c37dcc353 req-cd2c3d42-97e5-4813-9b0d-946ba65ad238 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044686 Jun 16 18:07:05.048145 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 28/56] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:05.055233 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-11eee555-9689-4af0-b816-2e2b2b462f67 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:05.056238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-11eee555-9689-4af0-b816-2e2b2b462f67 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:05.080320 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-fe767279-5024-4556-a421-226caacfa1ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:05.088254 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-fe767279-5024-4556-a421-226caacfa1ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.247629 Jun 16 18:07:05.089006 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 29/57] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:04 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:05.102681 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-93f36607-1f08-4928-ae32-6afe6c48795f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:05.103487 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-93f36607-1f08-4928-ae32-6afe6c48795f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:05.120689 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-11eee555-9689-4af0-b816-2e2b2b462f67 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:05.128679 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-11eee555-9689-4af0-b816-2e2b2b462f67 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1241 microversion: 2.1 time: 0.078212 Jun 16 18:07:05.138900 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 29/58] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:05 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:05.167553 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-93f36607-1f08-4928-ae32-6afe6c48795f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:05.179051 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-93f36607-1f08-4928-ae32-6afe6c48795f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1236 microversion: 2.1 time: 0.087306 Jun 16 18:07:05.179975 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 30/59] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:05 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:05.858352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7d31299c-b84f-47c4-9e33-3e8545eb2553 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:05.859576 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7d31299c-b84f-47c4-9e33-3e8545eb2553 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:05.866550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7d31299c-b84f-47c4-9e33-3e8545eb2553 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:05.867311 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7d31299c-b84f-47c4-9e33-3e8545eb2553 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:05.868278 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7d31299c-b84f-47c4-9e33-3e8545eb2553 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:05.868720 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7d31299c-b84f-47c4-9e33-3e8545eb2553 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:06.028410 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-172c0869-1add-4f6b-83d8-3907f6f86b92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:06.034376 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-172c0869-1add-4f6b-83d8-3907f6f86b92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:06.053306 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-172c0869-1add-4f6b-83d8-3907f6f86b92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:06.054082 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-172c0869-1add-4f6b-83d8-3907f6f86b92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:06.055263 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-172c0869-1add-4f6b-83d8-3907f6f86b92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:06.056042 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-172c0869-1add-4f6b-83d8-3907f6f86b92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:06.193079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-172c0869-1add-4f6b-83d8-3907f6f86b92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:06.205010 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-172c0869-1add-4f6b-83d8-3907f6f86b92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:06.207596 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-172c0869-1add-4f6b-83d8-3907f6f86b92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:06.208067 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7d31299c-b84f-47c4-9e33-3e8545eb2553 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:06.209174 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-172c0869-1add-4f6b-83d8-3907f6f86b92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1284 microversion: 2.20 time: 0.194590 Jun 16 18:07:06.209808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 31/60] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:06 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:06.220363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7d31299c-b84f-47c4-9e33-3e8545eb2553 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.365415 Jun 16 18:07:06.220363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 30/61] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:05 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:06.224777 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e589c591-5d14-4f21-bb2b-799d81a7c1b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:06.225384 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e589c591-5d14-4f21-bb2b-799d81a7c1b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:06.225777 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f3080d22-97af-4caa-a01e-2243c3a74806 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:06.226828 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f3080d22-97af-4caa-a01e-2243c3a74806 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:06.234700 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e589c591-5d14-4f21-bb2b-799d81a7c1b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:06.240280 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e589c591-5d14-4f21-bb2b-799d81a7c1b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:06.240280 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e589c591-5d14-4f21-bb2b-799d81a7c1b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:06.240487 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3080d22-97af-4caa-a01e-2243c3a74806 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:06.240600 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e589c591-5d14-4f21-bb2b-799d81a7c1b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:06.240694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3080d22-97af-4caa-a01e-2243c3a74806 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:06.240694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3080d22-97af-4caa-a01e-2243c3a74806 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:06.240694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3080d22-97af-4caa-a01e-2243c3a74806 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:06.334484 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f3080d22-97af-4caa-a01e-2243c3a74806 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:06.343357 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f3080d22-97af-4caa-a01e-2243c3a74806 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1245 microversion: 2.1 time: 0.121306 Jun 16 18:07:06.344323 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 32/62] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:06 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1245 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:06.351117 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-92fc743c-68a5-4b42-b46a-80dbee744350 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:06.351752 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-92fc743c-68a5-4b42-b46a-80dbee744350 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:06.442070 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-92fc743c-68a5-4b42-b46a-80dbee744350 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:06.445080 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e589c591-5d14-4f21-bb2b-799d81a7c1b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:06.449099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-92fc743c-68a5-4b42-b46a-80dbee744350 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1236 microversion: 2.1 time: 0.103619 Jun 16 18:07:06.449662 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 33/63] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:06 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:06.453312 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e589c591-5d14-4f21-bb2b-799d81a7c1b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.232041 Jun 16 18:07:06.453881 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 31/64] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:06 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:07.228645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0a9598ec-7099-4f0d-9143-e8a2b19f64d7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:07.229187 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0a9598ec-7099-4f0d-9143-e8a2b19f64d7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:07.236648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0a9598ec-7099-4f0d-9143-e8a2b19f64d7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:07.237097 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0a9598ec-7099-4f0d-9143-e8a2b19f64d7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:07.237863 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0a9598ec-7099-4f0d-9143-e8a2b19f64d7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:07.238290 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0a9598ec-7099-4f0d-9143-e8a2b19f64d7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:07.238913 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9d05bc14-554f-468e-9cf3-26633d51c40a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:07.240104 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9d05bc14-554f-468e-9cf3-26633d51c40a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:07.261881 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9d05bc14-554f-468e-9cf3-26633d51c40a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:07.262515 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9d05bc14-554f-468e-9cf3-26633d51c40a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:07.264175 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9d05bc14-554f-468e-9cf3-26633d51c40a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:07.264945 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9d05bc14-554f-468e-9cf3-26633d51c40a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:07.310983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0a9598ec-7099-4f0d-9143-e8a2b19f64d7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:07.319491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0a9598ec-7099-4f0d-9143-e8a2b19f64d7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:07.321289 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0a9598ec-7099-4f0d-9143-e8a2b19f64d7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:07.322489 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0a9598ec-7099-4f0d-9143-e8a2b19f64d7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1276 microversion: 2.20 time: 0.097861 Jun 16 18:07:07.323419 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 34/65] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:07 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:07.362797 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e3345e53-a71f-415b-a060-2f581ef42f26 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:07.363618 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e3345e53-a71f-415b-a060-2f581ef42f26 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:07.369885 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e3345e53-a71f-415b-a060-2f581ef42f26 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:07.370338 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e3345e53-a71f-415b-a060-2f581ef42f26 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:07.371126 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e3345e53-a71f-415b-a060-2f581ef42f26 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:07.371577 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e3345e53-a71f-415b-a060-2f581ef42f26 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:07.398563 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=100 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:07.410026 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9d05bc14-554f-468e-9cf3-26633d51c40a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:07.420101 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9d05bc14-554f-468e-9cf3-26633d51c40a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.185419 Jun 16 18:07:07.420829 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 32/66] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:07 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:07.451187 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e3345e53-a71f-415b-a060-2f581ef42f26 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:07.458810 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e3345e53-a71f-415b-a060-2f581ef42f26 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1245 microversion: 2.1 time: 0.100353 Jun 16 18:07:07.459383 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 35/67] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:07 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1245 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:07.469422 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-cd8ef68d-59a4-4387-8eb7-43fa333383e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:07.470310 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-cd8ef68d-59a4-4387-8eb7-43fa333383e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:07.471479 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-705ecd95-1245-48bf-89dd-d27404f20ef9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:07.472105 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-705ecd95-1245-48bf-89dd-d27404f20ef9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:07.477529 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cd8ef68d-59a4-4387-8eb7-43fa333383e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:07.478058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cd8ef68d-59a4-4387-8eb7-43fa333383e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:07.478311 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-705ecd95-1245-48bf-89dd-d27404f20ef9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:07.478796 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-705ecd95-1245-48bf-89dd-d27404f20ef9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:07.478932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cd8ef68d-59a4-4387-8eb7-43fa333383e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:07.479351 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cd8ef68d-59a4-4387-8eb7-43fa333383e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:07.480183 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-705ecd95-1245-48bf-89dd-d27404f20ef9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:07.480777 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-705ecd95-1245-48bf-89dd-d27404f20ef9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:07.568547 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-cd8ef68d-59a4-4387-8eb7-43fa333383e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:07.576737 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-cd8ef68d-59a4-4387-8eb7-43fa333383e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1240 microversion: 2.1 time: 0.113251 Jun 16 18:07:07.577323 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 33/68] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:07 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:07.643893 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-705ecd95-1245-48bf-89dd-d27404f20ef9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:07.651406 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-705ecd95-1245-48bf-89dd-d27404f20ef9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.185927 Jun 16 18:07:07.657555 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 36/69] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:07 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:08.341021 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2918cee9-c7a9-49ce-b924-b2453a1a6faa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:08.341871 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2918cee9-c7a9-49ce-b924-b2453a1a6faa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:08.348126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2918cee9-c7a9-49ce-b924-b2453a1a6faa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:08.348565 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2918cee9-c7a9-49ce-b924-b2453a1a6faa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:08.349332 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2918cee9-c7a9-49ce-b924-b2453a1a6faa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:08.349762 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2918cee9-c7a9-49ce-b924-b2453a1a6faa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:08.414724 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2918cee9-c7a9-49ce-b924-b2453a1a6faa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:08.424202 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2918cee9-c7a9-49ce-b924-b2453a1a6faa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:08.427569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2918cee9-c7a9-49ce-b924-b2453a1a6faa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:08.427569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2918cee9-c7a9-49ce-b924-b2453a1a6faa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1276 microversion: 2.20 time: 0.089751 Jun 16 18:07:08.437149 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 34/70] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:08 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1276 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:08.438199 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-eea38564-d668-4f0c-95d2-3508e6acb902 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:08.438839 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-eea38564-d668-4f0c-95d2-3508e6acb902 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:08.445092 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-eea38564-d668-4f0c-95d2-3508e6acb902 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:08.445540 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-eea38564-d668-4f0c-95d2-3508e6acb902 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:08.446309 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-eea38564-d668-4f0c-95d2-3508e6acb902 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:08.446741 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-eea38564-d668-4f0c-95d2-3508e6acb902 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:08.476657 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-dcf19c75-8401-4874-a748-adc4b2e8e659 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:08.477386 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-dcf19c75-8401-4874-a748-adc4b2e8e659 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:08.486302 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dcf19c75-8401-4874-a748-adc4b2e8e659 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:08.487012 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dcf19c75-8401-4874-a748-adc4b2e8e659 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:08.487924 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dcf19c75-8401-4874-a748-adc4b2e8e659 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:08.488640 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dcf19c75-8401-4874-a748-adc4b2e8e659 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:08.563840 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-dcf19c75-8401-4874-a748-adc4b2e8e659 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:08.571595 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-dcf19c75-8401-4874-a748-adc4b2e8e659 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1245 microversion: 2.1 time: 0.098774 Jun 16 18:07:08.572144 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 35/71] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:08 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1245 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:08.594378 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7c70e831-1ab3-4bca-8cc6-ba87a490d81a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:08.594992 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7c70e831-1ab3-4bca-8cc6-ba87a490d81a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:08.601200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7c70e831-1ab3-4bca-8cc6-ba87a490d81a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:08.601651 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7c70e831-1ab3-4bca-8cc6-ba87a490d81a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:08.602422 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7c70e831-1ab3-4bca-8cc6-ba87a490d81a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:08.602858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7c70e831-1ab3-4bca-8cc6-ba87a490d81a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:08.609244 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-eea38564-d668-4f0c-95d2-3508e6acb902 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:08.616828 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-eea38564-d668-4f0c-95d2-3508e6acb902 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.183639 Jun 16 18:07:08.617396 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 37/72] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:08 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:08.667552 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7c70e831-1ab3-4bca-8cc6-ba87a490d81a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:08.668528 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5a3ea0f6-4cfb-4002-9eda-b71102f15d83 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:08.669143 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5a3ea0f6-4cfb-4002-9eda-b71102f15d83 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:08.675732 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7c70e831-1ab3-4bca-8cc6-ba87a490d81a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1240 microversion: 2.1 time: 0.085890 Jun 16 18:07:08.676310 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 36/73] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:08 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:08.676898 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5a3ea0f6-4cfb-4002-9eda-b71102f15d83 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:08.677354 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5a3ea0f6-4cfb-4002-9eda-b71102f15d83 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:08.678120 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5a3ea0f6-4cfb-4002-9eda-b71102f15d83 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:08.678544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5a3ea0f6-4cfb-4002-9eda-b71102f15d83 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:08.816824 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5a3ea0f6-4cfb-4002-9eda-b71102f15d83 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:08.824347 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5a3ea0f6-4cfb-4002-9eda-b71102f15d83 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.159734 Jun 16 18:07:08.824908 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 38/74] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:08 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:09.446234 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0a78e40b-2292-4bfe-93b1-9dcd5924a118 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:09.446871 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0a78e40b-2292-4bfe-93b1-9dcd5924a118 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:09.453065 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0a78e40b-2292-4bfe-93b1-9dcd5924a118 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:09.453511 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0a78e40b-2292-4bfe-93b1-9dcd5924a118 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:09.454266 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0a78e40b-2292-4bfe-93b1-9dcd5924a118 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:09.454698 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0a78e40b-2292-4bfe-93b1-9dcd5924a118 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:09.520780 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0a78e40b-2292-4bfe-93b1-9dcd5924a118 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:09.528815 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0a78e40b-2292-4bfe-93b1-9dcd5924a118 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:09.531068 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0a78e40b-2292-4bfe-93b1-9dcd5924a118 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:09.532218 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0a78e40b-2292-4bfe-93b1-9dcd5924a118 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1276 microversion: 2.20 time: 0.089894 Jun 16 18:07:09.532788 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 37/75] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:09 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:09.589109 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8edb834d-3731-4d73-a595-c7e7c1ccf931 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:09.589810 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8edb834d-3731-4d73-a595-c7e7c1ccf931 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:09.596322 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8edb834d-3731-4d73-a595-c7e7c1ccf931 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:09.596765 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8edb834d-3731-4d73-a595-c7e7c1ccf931 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:09.597519 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8edb834d-3731-4d73-a595-c7e7c1ccf931 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:09.597946 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8edb834d-3731-4d73-a595-c7e7c1ccf931 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:09.632947 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-23b5b93d-77db-4331-bf7a-31df0481f03a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:09.633559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-23b5b93d-77db-4331-bf7a-31df0481f03a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:09.640525 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-23b5b93d-77db-4331-bf7a-31df0481f03a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:09.640972 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-23b5b93d-77db-4331-bf7a-31df0481f03a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:09.641745 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-23b5b93d-77db-4331-bf7a-31df0481f03a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:09.642177 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-23b5b93d-77db-4331-bf7a-31df0481f03a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:09.663716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8edb834d-3731-4d73-a595-c7e7c1ccf931 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:09.671766 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8edb834d-3731-4d73-a595-c7e7c1ccf931 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1245 microversion: 2.1 time: 0.086337 Jun 16 18:07:09.680987 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 39/76] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:09 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:09.696032 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6be1157f-f5c4-43e0-8188-d7025554be13 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:09.696865 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6be1157f-f5c4-43e0-8188-d7025554be13 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:09.704533 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6be1157f-f5c4-43e0-8188-d7025554be13 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:09.704980 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6be1157f-f5c4-43e0-8188-d7025554be13 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:09.705735 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6be1157f-f5c4-43e0-8188-d7025554be13 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:09.706163 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6be1157f-f5c4-43e0-8188-d7025554be13 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:09.783834 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6be1157f-f5c4-43e0-8188-d7025554be13 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:09.791113 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6be1157f-f5c4-43e0-8188-d7025554be13 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1240 microversion: 2.1 time: 0.099141 Jun 16 18:07:09.791705 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 40/77] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:09 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:09.806876 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-23b5b93d-77db-4331-bf7a-31df0481f03a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:09.815088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-23b5b93d-77db-4331-bf7a-31df0481f03a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.185972 Jun 16 18:07:09.815683 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 38/78] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:09 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:09.841889 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-160c1032-b792-49ea-a384-89e6b2eeb19c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:09.843039 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-160c1032-b792-49ea-a384-89e6b2eeb19c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:09.849021 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-160c1032-b792-49ea-a384-89e6b2eeb19c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:09.849474 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-160c1032-b792-49ea-a384-89e6b2eeb19c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:09.850231 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-160c1032-b792-49ea-a384-89e6b2eeb19c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:09.850663 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-160c1032-b792-49ea-a384-89e6b2eeb19c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:09.985985 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-160c1032-b792-49ea-a384-89e6b2eeb19c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:09.993665 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-160c1032-b792-49ea-a384-89e6b2eeb19c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.155667 Jun 16 18:07:09.994202 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 41/79] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:09 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:10.550736 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-78318eae-3941-4428-bc54-bb57691f925e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:10.551345 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-78318eae-3941-4428-bc54-bb57691f925e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:10.557388 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-78318eae-3941-4428-bc54-bb57691f925e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:10.557836 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-78318eae-3941-4428-bc54-bb57691f925e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:10.558788 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-78318eae-3941-4428-bc54-bb57691f925e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:10.559046 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-78318eae-3941-4428-bc54-bb57691f925e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:10.620917 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-78318eae-3941-4428-bc54-bb57691f925e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:10.630077 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-78318eae-3941-4428-bc54-bb57691f925e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:10.631592 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-78318eae-3941-4428-bc54-bb57691f925e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:10.632667 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-78318eae-3941-4428-bc54-bb57691f925e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1276 microversion: 2.20 time: 0.085821 Jun 16 18:07:10.633217 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 39/80] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:10 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:10.689763 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8127924c-b9f6-43eb-941c-534b835edad7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:10.698843 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8127924c-b9f6-43eb-941c-534b835edad7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:10.698843 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8127924c-b9f6-43eb-941c-534b835edad7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:10.698843 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8127924c-b9f6-43eb-941c-534b835edad7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:10.698843 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8127924c-b9f6-43eb-941c-534b835edad7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:10.699286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8127924c-b9f6-43eb-941c-534b835edad7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:10.763032 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8127924c-b9f6-43eb-941c-534b835edad7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:10.771472 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8127924c-b9f6-43eb-941c-534b835edad7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1245 microversion: 2.1 time: 0.086734 Jun 16 18:07:10.772035 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 42/81] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:10 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:10.808720 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a6c9294f-dcd7-40bc-b540-b49ee1135be3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:10.809334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a6c9294f-dcd7-40bc-b540-b49ee1135be3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:10.815674 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a6c9294f-dcd7-40bc-b540-b49ee1135be3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:10.816131 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a6c9294f-dcd7-40bc-b540-b49ee1135be3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:10.816897 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a6c9294f-dcd7-40bc-b540-b49ee1135be3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:10.817332 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a6c9294f-dcd7-40bc-b540-b49ee1135be3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:10.837076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0c31c84c-f467-4479-9150-9cb0daa51a4f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:10.837076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0c31c84c-f467-4479-9150-9cb0daa51a4f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:10.841706 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0c31c84c-f467-4479-9150-9cb0daa51a4f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:10.842150 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0c31c84c-f467-4479-9150-9cb0daa51a4f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:10.843781 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0c31c84c-f467-4479-9150-9cb0daa51a4f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:10.844424 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0c31c84c-f467-4479-9150-9cb0daa51a4f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:10.888888 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a6c9294f-dcd7-40bc-b540-b49ee1135be3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:10.896973 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a6c9294f-dcd7-40bc-b540-b49ee1135be3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1240 microversion: 2.1 time: 0.091995 Jun 16 18:07:10.897552 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 40/82] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:10 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:10.998505 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0c31c84c-f467-4479-9150-9cb0daa51a4f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:11.009803 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0c31c84c-f467-4479-9150-9cb0daa51a4f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.178679 Jun 16 18:07:11.011408 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 43/83] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:10 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:11.012131 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-570a5b63-65cd-4e9f-8414-25b0bdae9188 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:11.012746 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-570a5b63-65cd-4e9f-8414-25b0bdae9188 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:11.020260 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-570a5b63-65cd-4e9f-8414-25b0bdae9188 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:11.022099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-570a5b63-65cd-4e9f-8414-25b0bdae9188 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:11.022099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-570a5b63-65cd-4e9f-8414-25b0bdae9188 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:11.022099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-570a5b63-65cd-4e9f-8414-25b0bdae9188 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:11.158371 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-570a5b63-65cd-4e9f-8414-25b0bdae9188 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:11.166196 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-570a5b63-65cd-4e9f-8414-25b0bdae9188 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.158008 Jun 16 18:07:11.166816 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 41/84] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:11 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:11.650275 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1bafd325-f28a-4338-b667-0cb412e224b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:11.650793 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1bafd325-f28a-4338-b667-0cb412e224b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:11.657763 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1bafd325-f28a-4338-b667-0cb412e224b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:11.658205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1bafd325-f28a-4338-b667-0cb412e224b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:11.658972 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1bafd325-f28a-4338-b667-0cb412e224b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:11.659434 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1bafd325-f28a-4338-b667-0cb412e224b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:11.726745 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1bafd325-f28a-4338-b667-0cb412e224b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:11.735053 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1bafd325-f28a-4338-b667-0cb412e224b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:11.736588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1bafd325-f28a-4338-b667-0cb412e224b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:11.738829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1bafd325-f28a-4338-b667-0cb412e224b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1276 microversion: 2.20 time: 0.091726 Jun 16 18:07:11.738829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 44/85] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:11 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:11.789081 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-59d0675b-b7f9-442f-99ed-2d859cdf9a45 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:11.790103 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-59d0675b-b7f9-442f-99ed-2d859cdf9a45 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:11.797637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-59d0675b-b7f9-442f-99ed-2d859cdf9a45 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:11.798091 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-59d0675b-b7f9-442f-99ed-2d859cdf9a45 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:11.798923 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-59d0675b-b7f9-442f-99ed-2d859cdf9a45 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:11.799354 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-59d0675b-b7f9-442f-99ed-2d859cdf9a45 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:11.861988 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-59d0675b-b7f9-442f-99ed-2d859cdf9a45 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:11.870090 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-59d0675b-b7f9-442f-99ed-2d859cdf9a45 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1245 microversion: 2.1 time: 0.085461 Jun 16 18:07:11.870776 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 42/86] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:11 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:11.915223 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a3ce0560-aadd-413a-8e6e-fb3cc2adfc7b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:11.915874 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a3ce0560-aadd-413a-8e6e-fb3cc2adfc7b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:11.922667 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a3ce0560-aadd-413a-8e6e-fb3cc2adfc7b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:11.923118 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a3ce0560-aadd-413a-8e6e-fb3cc2adfc7b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:11.923929 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a3ce0560-aadd-413a-8e6e-fb3cc2adfc7b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:11.924369 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a3ce0560-aadd-413a-8e6e-fb3cc2adfc7b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:11.989466 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a3ce0560-aadd-413a-8e6e-fb3cc2adfc7b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:11.996966 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a3ce0560-aadd-413a-8e6e-fb3cc2adfc7b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1240 microversion: 2.1 time: 0.085676 Jun 16 18:07:11.997529 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 45/87] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:11 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:12.027582 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9987800d-a019-445e-abe9-743a41dd0558 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:12.028235 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9987800d-a019-445e-abe9-743a41dd0558 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:12.035560 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9987800d-a019-445e-abe9-743a41dd0558 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:12.036009 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9987800d-a019-445e-abe9-743a41dd0558 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:12.036770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9987800d-a019-445e-abe9-743a41dd0558 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:12.037197 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9987800d-a019-445e-abe9-743a41dd0558 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:12.179686 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9987800d-a019-445e-abe9-743a41dd0558 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:12.183740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a858b287-becb-4fcf-8fbe-4a71c1d1600d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:12.184799 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a858b287-becb-4fcf-8fbe-4a71c1d1600d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:12.188343 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9987800d-a019-445e-abe9-743a41dd0558 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.164494 Jun 16 18:07:12.188935 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 43/88] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:12 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:12.192797 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a858b287-becb-4fcf-8fbe-4a71c1d1600d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:12.193508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a858b287-becb-4fcf-8fbe-4a71c1d1600d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:12.194529 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a858b287-becb-4fcf-8fbe-4a71c1d1600d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:12.195208 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a858b287-becb-4fcf-8fbe-4a71c1d1600d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:12.339457 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a858b287-becb-4fcf-8fbe-4a71c1d1600d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:12.348639 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a858b287-becb-4fcf-8fbe-4a71c1d1600d tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.169531 Jun 16 18:07:12.349316 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 46/89] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:12 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:12.756147 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7c1bec93-0cf1-4b78-8a84-542e2b407d50 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:12.756698 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7c1bec93-0cf1-4b78-8a84-542e2b407d50 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:12.763081 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7c1bec93-0cf1-4b78-8a84-542e2b407d50 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:12.763566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7c1bec93-0cf1-4b78-8a84-542e2b407d50 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:12.764335 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7c1bec93-0cf1-4b78-8a84-542e2b407d50 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:12.764765 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7c1bec93-0cf1-4b78-8a84-542e2b407d50 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:12.829635 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7c1bec93-0cf1-4b78-8a84-542e2b407d50 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:12.837701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7c1bec93-0cf1-4b78-8a84-542e2b407d50 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:12.839201 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7c1bec93-0cf1-4b78-8a84-542e2b407d50 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:12.840334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7c1bec93-0cf1-4b78-8a84-542e2b407d50 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1276 microversion: 2.20 time: 0.088287 Jun 16 18:07:12.840886 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 44/90] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:12 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:12.887915 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d500dec9-bd33-482c-b824-6360e731c1dd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:12.888487 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d500dec9-bd33-482c-b824-6360e731c1dd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:12.895582 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d500dec9-bd33-482c-b824-6360e731c1dd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:12.896027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d500dec9-bd33-482c-b824-6360e731c1dd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:12.896831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d500dec9-bd33-482c-b824-6360e731c1dd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:12.897261 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d500dec9-bd33-482c-b824-6360e731c1dd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:12.959910 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d500dec9-bd33-482c-b824-6360e731c1dd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:12.967536 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d500dec9-bd33-482c-b824-6360e731c1dd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1245 microversion: 2.1 time: 0.083433 Jun 16 18:07:12.968116 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 47/91] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:12 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:13.014342 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-089d92a0-7838-4b3c-ae6b-370526585ec8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:13.014969 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-089d92a0-7838-4b3c-ae6b-370526585ec8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:13.021909 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-089d92a0-7838-4b3c-ae6b-370526585ec8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:13.022358 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-089d92a0-7838-4b3c-ae6b-370526585ec8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:13.023121 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-089d92a0-7838-4b3c-ae6b-370526585ec8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:13.023607 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-089d92a0-7838-4b3c-ae6b-370526585ec8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:13.026257 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=100 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:13.088050 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-089d92a0-7838-4b3c-ae6b-370526585ec8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:13.095504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-089d92a0-7838-4b3c-ae6b-370526585ec8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1240 microversion: 2.1 time: 0.085246 Jun 16 18:07:13.096081 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 45/92] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:13 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:13.205597 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0ed40312-51b5-4b78-9ec9-c97145c3f9d1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:13.206206 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0ed40312-51b5-4b78-9ec9-c97145c3f9d1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:13.212351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ed40312-51b5-4b78-9ec9-c97145c3f9d1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:13.212799 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ed40312-51b5-4b78-9ec9-c97145c3f9d1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:13.213578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ed40312-51b5-4b78-9ec9-c97145c3f9d1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:13.214014 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ed40312-51b5-4b78-9ec9-c97145c3f9d1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:13.350122 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0ed40312-51b5-4b78-9ec9-c97145c3f9d1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:13.357757 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0ed40312-51b5-4b78-9ec9-c97145c3f9d1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.156655 Jun 16 18:07:13.358316 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 48/93] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:13 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:13.366848 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-dc103745-1c05-4dff-b58d-22aafe29d54c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:13.367607 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-dc103745-1c05-4dff-b58d-22aafe29d54c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:13.373855 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dc103745-1c05-4dff-b58d-22aafe29d54c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:13.376143 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dc103745-1c05-4dff-b58d-22aafe29d54c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:13.376143 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dc103745-1c05-4dff-b58d-22aafe29d54c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:13.376365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dc103745-1c05-4dff-b58d-22aafe29d54c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:13.506528 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-dc103745-1c05-4dff-b58d-22aafe29d54c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:13.514084 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-dc103745-1c05-4dff-b58d-22aafe29d54c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.151498 Jun 16 18:07:13.514661 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 46/94] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:13 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:13.858722 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-493ca393-1c5a-4339-a869-051efb2408a1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:13.859393 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-493ca393-1c5a-4339-a869-051efb2408a1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:13.866318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-493ca393-1c5a-4339-a869-051efb2408a1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:13.869186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-493ca393-1c5a-4339-a869-051efb2408a1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:13.869186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-493ca393-1c5a-4339-a869-051efb2408a1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:13.869186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-493ca393-1c5a-4339-a869-051efb2408a1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:13.933021 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-493ca393-1c5a-4339-a869-051efb2408a1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:13.942028 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-493ca393-1c5a-4339-a869-051efb2408a1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:13.943603 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-493ca393-1c5a-4339-a869-051efb2408a1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:13.944753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-493ca393-1c5a-4339-a869-051efb2408a1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1276 microversion: 2.20 time: 0.090055 Jun 16 18:07:13.945314 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 49/95] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:13 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:13.986000 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6dc3509b-2569-410a-b08c-3a13ced06449 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:13.986593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6dc3509b-2569-410a-b08c-3a13ced06449 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:13.993279 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6dc3509b-2569-410a-b08c-3a13ced06449 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:13.993727 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6dc3509b-2569-410a-b08c-3a13ced06449 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:13.994492 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6dc3509b-2569-410a-b08c-3a13ced06449 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:13.994973 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6dc3509b-2569-410a-b08c-3a13ced06449 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:14.057548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6dc3509b-2569-410a-b08c-3a13ced06449 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:14.065763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6dc3509b-2569-410a-b08c-3a13ced06449 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1245 microversion: 2.1 time: 0.084117 Jun 16 18:07:14.066423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 47/96] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:13 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:14.112743 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c98f6ea0-fd76-4714-a2dd-e7834e9f7868 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:14.113527 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c98f6ea0-fd76-4714-a2dd-e7834e9f7868 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:14.122311 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c98f6ea0-fd76-4714-a2dd-e7834e9f7868 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:14.123120 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c98f6ea0-fd76-4714-a2dd-e7834e9f7868 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:14.124513 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c98f6ea0-fd76-4714-a2dd-e7834e9f7868 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:14.125836 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c98f6ea0-fd76-4714-a2dd-e7834e9f7868 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:14.194500 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c98f6ea0-fd76-4714-a2dd-e7834e9f7868 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:14.201976 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c98f6ea0-fd76-4714-a2dd-e7834e9f7868 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1240 microversion: 2.1 time: 0.093747 Jun 16 18:07:14.202551 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 50/97] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:14 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:14.376438 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-78e66bc3-4de9-4e4e-8088-55fa001f5a7a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:14.377179 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-78e66bc3-4de9-4e4e-8088-55fa001f5a7a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:14.383626 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-78e66bc3-4de9-4e4e-8088-55fa001f5a7a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:14.385326 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-78e66bc3-4de9-4e4e-8088-55fa001f5a7a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:14.385326 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-78e66bc3-4de9-4e4e-8088-55fa001f5a7a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:14.385326 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-78e66bc3-4de9-4e4e-8088-55fa001f5a7a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:14.504622 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=6 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:14.528141 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=4 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:14.533768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1065570c-0d4b-4505-9257-4396fb55dd38 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:14.534687 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1065570c-0d4b-4505-9257-4396fb55dd38 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:14.536158 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-78e66bc3-4de9-4e4e-8088-55fa001f5a7a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:14.542195 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1065570c-0d4b-4505-9257-4396fb55dd38 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:14.542898 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1065570c-0d4b-4505-9257-4396fb55dd38 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:14.543559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-78e66bc3-4de9-4e4e-8088-55fa001f5a7a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.171059 Jun 16 18:07:14.543961 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1065570c-0d4b-4505-9257-4396fb55dd38 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:14.544399 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1065570c-0d4b-4505-9257-4396fb55dd38 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:14.544863 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 48/98] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:14 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:14.690104 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1065570c-0d4b-4505-9257-4396fb55dd38 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:14.698130 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1065570c-0d4b-4505-9257-4396fb55dd38 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.170677 Jun 16 18:07:14.698718 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 51/99] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:14 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:14.964207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-dfd0911d-b238-4fb2-9f43-4a098eb0772c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:14.964821 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-dfd0911d-b238-4fb2-9f43-4a098eb0772c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:14.972108 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfd0911d-b238-4fb2-9f43-4a098eb0772c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:14.972595 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfd0911d-b238-4fb2-9f43-4a098eb0772c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:14.973377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfd0911d-b238-4fb2-9f43-4a098eb0772c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:14.973850 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfd0911d-b238-4fb2-9f43-4a098eb0772c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:15.050206 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-dfd0911d-b238-4fb2-9f43-4a098eb0772c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:15.060372 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-dfd0911d-b238-4fb2-9f43-4a098eb0772c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:15.061886 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-dfd0911d-b238-4fb2-9f43-4a098eb0772c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:15.063705 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-dfd0911d-b238-4fb2-9f43-4a098eb0772c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1276 microversion: 2.20 time: 0.102854 Jun 16 18:07:15.064592 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 49/100] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:14 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1276 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:15.083436 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-29725657-6ecb-4060-8a70-fb40d7eaccf5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:15.087351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-29725657-6ecb-4060-8a70-fb40d7eaccf5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:15.090353 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-29725657-6ecb-4060-8a70-fb40d7eaccf5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:15.090792 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-29725657-6ecb-4060-8a70-fb40d7eaccf5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:15.091595 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-29725657-6ecb-4060-8a70-fb40d7eaccf5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:15.092027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-29725657-6ecb-4060-8a70-fb40d7eaccf5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:15.096303 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=100 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:15.161570 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-29725657-6ecb-4060-8a70-fb40d7eaccf5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:15.169895 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-29725657-6ecb-4060-8a70-fb40d7eaccf5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1245 microversion: 2.1 time: 0.090380 Jun 16 18:07:15.170471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 52/101] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:15 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:15.225316 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8a39cbd1-bf82-4ecc-ac04-e695ad7fd6f2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:15.225955 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8a39cbd1-bf82-4ecc-ac04-e695ad7fd6f2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:15.228125 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=16 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:15.249045 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8a39cbd1-bf82-4ecc-ac04-e695ad7fd6f2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:15.249773 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8a39cbd1-bf82-4ecc-ac04-e695ad7fd6f2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:15.250327 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8a39cbd1-bf82-4ecc-ac04-e695ad7fd6f2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:15.250761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8a39cbd1-bf82-4ecc-ac04-e695ad7fd6f2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:15.332359 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8a39cbd1-bf82-4ecc-ac04-e695ad7fd6f2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:15.344760 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8a39cbd1-bf82-4ecc-ac04-e695ad7fd6f2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1240 microversion: 2.1 time: 0.125115 Jun 16 18:07:15.345353 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 50/102] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:15 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1240 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:15.562075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-65366949-10d6-4c8e-98e6-aa0e96608f75 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:15.562688 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-65366949-10d6-4c8e-98e6-aa0e96608f75 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:15.568951 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-65366949-10d6-4c8e-98e6-aa0e96608f75 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:15.569401 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-65366949-10d6-4c8e-98e6-aa0e96608f75 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:15.570161 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-65366949-10d6-4c8e-98e6-aa0e96608f75 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:15.570665 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-65366949-10d6-4c8e-98e6-aa0e96608f75 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:15.703350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-65366949-10d6-4c8e-98e6-aa0e96608f75 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:15.713240 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-65366949-10d6-4c8e-98e6-aa0e96608f75 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.155088 Jun 16 18:07:15.716403 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-32198066-dde6-48fc-bb8b-16e3f343b748 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:15.717133 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-32198066-dde6-48fc-bb8b-16e3f343b748 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:15.721474 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 53/103] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:15 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:15.725127 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-32198066-dde6-48fc-bb8b-16e3f343b748 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:15.725635 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-32198066-dde6-48fc-bb8b-16e3f343b748 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:15.726594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-32198066-dde6-48fc-bb8b-16e3f343b748 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:15.727012 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-32198066-dde6-48fc-bb8b-16e3f343b748 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:15.873470 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-32198066-dde6-48fc-bb8b-16e3f343b748 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:15.881141 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-32198066-dde6-48fc-bb8b-16e3f343b748 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.168751 Jun 16 18:07:15.881705 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 51/104] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:15 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:16.085874 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-05507715-c246-42bb-bf6b-35c69bca5017 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:16.086478 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-05507715-c246-42bb-bf6b-35c69bca5017 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:16.092461 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-05507715-c246-42bb-bf6b-35c69bca5017 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:16.092905 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-05507715-c246-42bb-bf6b-35c69bca5017 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:16.093649 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-05507715-c246-42bb-bf6b-35c69bca5017 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:16.094069 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-05507715-c246-42bb-bf6b-35c69bca5017 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:16.187043 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-05507715-c246-42bb-bf6b-35c69bca5017 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:16.195913 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-05507715-c246-42bb-bf6b-35c69bca5017 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:16.197434 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-05507715-c246-42bb-bf6b-35c69bca5017 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:16.198579 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-05507715-c246-42bb-bf6b-35c69bca5017 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1276 microversion: 2.20 time: 0.116626 Jun 16 18:07:16.202391 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 54/105] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:16 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1276 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:16.202515 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-12ae39b0-9427-424a-ba9e-78b918ce0903 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:16.202515 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-12ae39b0-9427-424a-ba9e-78b918ce0903 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:16.209783 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-12ae39b0-9427-424a-ba9e-78b918ce0903 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:16.210235 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-12ae39b0-9427-424a-ba9e-78b918ce0903 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:16.211040 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-12ae39b0-9427-424a-ba9e-78b918ce0903 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:16.211517 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-12ae39b0-9427-424a-ba9e-78b918ce0903 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:16.273584 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-12ae39b0-9427-424a-ba9e-78b918ce0903 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:16.281180 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-12ae39b0-9427-424a-ba9e-78b918ce0903 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1245 microversion: 2.1 time: 0.084062 Jun 16 18:07:16.281793 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 52/106] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:16 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:16.362977 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-12792680-2115-4dca-9098-bc797330cfbe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:16.363606 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-12792680-2115-4dca-9098-bc797330cfbe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:16.370154 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-12792680-2115-4dca-9098-bc797330cfbe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:16.370604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-12792680-2115-4dca-9098-bc797330cfbe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:16.371413 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-12792680-2115-4dca-9098-bc797330cfbe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:16.371851 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-12792680-2115-4dca-9098-bc797330cfbe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:16.433412 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-12792680-2115-4dca-9098-bc797330cfbe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:16.441482 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-12792680-2115-4dca-9098-bc797330cfbe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1240 microversion: 2.1 time: 0.082847 Jun 16 18:07:16.442052 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 55/107] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:16 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:16.730875 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-29dc4c72-2f9a-4fb9-86a3-cbc5e7a94d9e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:16.731553 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-29dc4c72-2f9a-4fb9-86a3-cbc5e7a94d9e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:16.738293 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-29dc4c72-2f9a-4fb9-86a3-cbc5e7a94d9e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:16.738755 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-29dc4c72-2f9a-4fb9-86a3-cbc5e7a94d9e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:16.739808 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-29dc4c72-2f9a-4fb9-86a3-cbc5e7a94d9e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:16.740246 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-29dc4c72-2f9a-4fb9-86a3-cbc5e7a94d9e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:16.898092 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-29dc4c72-2f9a-4fb9-86a3-cbc5e7a94d9e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:16.900592 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f72022bb-af06-43be-a74e-a3aeea2ad0b9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:16.901330 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f72022bb-af06-43be-a74e-a3aeea2ad0b9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:16.906307 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=10 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:16.909679 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-29dc4c72-2f9a-4fb9-86a3-cbc5e7a94d9e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.182595 Jun 16 18:07:16.920791 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f72022bb-af06-43be-a74e-a3aeea2ad0b9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:16.920791 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f72022bb-af06-43be-a74e-a3aeea2ad0b9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:16.920791 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f72022bb-af06-43be-a74e-a3aeea2ad0b9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:16.920791 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f72022bb-af06-43be-a74e-a3aeea2ad0b9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:16.923941 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 53/108] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:16 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:17.102951 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f72022bb-af06-43be-a74e-a3aeea2ad0b9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:17.112065 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f72022bb-af06-43be-a74e-a3aeea2ad0b9 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.216183 Jun 16 18:07:17.122218 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 56/109] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:16 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:17.217958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6f7bff45-fc89-49ca-bbde-9b0be2d02b6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:17.218570 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6f7bff45-fc89-49ca-bbde-9b0be2d02b6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:17.225290 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f7bff45-fc89-49ca-bbde-9b0be2d02b6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:17.225876 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f7bff45-fc89-49ca-bbde-9b0be2d02b6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:17.226648 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f7bff45-fc89-49ca-bbde-9b0be2d02b6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:17.227075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f7bff45-fc89-49ca-bbde-9b0be2d02b6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:17.295394 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6f7bff45-fc89-49ca-bbde-9b0be2d02b6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:17.298623 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-96f756d8-cb04-4ad5-9934-45a4ff72e138 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:17.299294 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-96f756d8-cb04-4ad5-9934-45a4ff72e138 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:17.305836 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6f7bff45-fc89-49ca-bbde-9b0be2d02b6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:17.307047 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-96f756d8-cb04-4ad5-9934-45a4ff72e138 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:17.307563 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-96f756d8-cb04-4ad5-9934-45a4ff72e138 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:17.308306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6f7bff45-fc89-49ca-bbde-9b0be2d02b6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:17.308888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-96f756d8-cb04-4ad5-9934-45a4ff72e138 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:17.309386 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-96f756d8-cb04-4ad5-9934-45a4ff72e138 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:17.309484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6f7bff45-fc89-49ca-bbde-9b0be2d02b6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1332 microversion: 2.20 time: 0.095397 Jun 16 18:07:17.309987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 54/110] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:17 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:17.372721 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-96f756d8-cb04-4ad5-9934-45a4ff72e138 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:17.381818 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-96f756d8-cb04-4ad5-9934-45a4ff72e138 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1237 microversion: 2.1 time: 0.087265 Jun 16 18:07:17.382202 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 57/111] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:17 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:17.458356 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ca2ba703-680f-4125-969e-65e75f6ddc8c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:17.458967 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ca2ba703-680f-4125-969e-65e75f6ddc8c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:17.464999 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ca2ba703-680f-4125-969e-65e75f6ddc8c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:17.465455 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ca2ba703-680f-4125-969e-65e75f6ddc8c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:17.466221 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ca2ba703-680f-4125-969e-65e75f6ddc8c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:17.466655 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ca2ba703-680f-4125-969e-65e75f6ddc8c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:17.530859 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ca2ba703-680f-4125-969e-65e75f6ddc8c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:17.538458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ca2ba703-680f-4125-969e-65e75f6ddc8c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1232 microversion: 2.1 time: 0.084314 Jun 16 18:07:17.539034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 55/112] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:17 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1232 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:17.929119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-042e668d-4a82-4460-890b-467df0b8853f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:17.929945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-042e668d-4a82-4460-890b-467df0b8853f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:17.936641 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-042e668d-4a82-4460-890b-467df0b8853f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:17.943044 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-042e668d-4a82-4460-890b-467df0b8853f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:17.943044 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-042e668d-4a82-4460-890b-467df0b8853f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:17.943044 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-042e668d-4a82-4460-890b-467df0b8853f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:18.076412 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-042e668d-4a82-4460-890b-467df0b8853f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:18.084669 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-042e668d-4a82-4460-890b-467df0b8853f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.159506 Jun 16 18:07:18.085244 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 58/113] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:17 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:18.130564 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a4b2b016-1751-4cce-8047-1ad6e85421b5 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:18.131404 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a4b2b016-1751-4cce-8047-1ad6e85421b5 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:18.137675 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a4b2b016-1751-4cce-8047-1ad6e85421b5 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:18.138229 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a4b2b016-1751-4cce-8047-1ad6e85421b5 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:18.139058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a4b2b016-1751-4cce-8047-1ad6e85421b5 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:18.139586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a4b2b016-1751-4cce-8047-1ad6e85421b5 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:18.308892 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a4b2b016-1751-4cce-8047-1ad6e85421b5 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:18.316718 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a4b2b016-1751-4cce-8047-1ad6e85421b5 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.191049 Jun 16 18:07:18.317383 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 56/114] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:18 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:18.335911 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dad1278c-b416-4522-a2c1-bba5b24aa97b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:18.335911 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-dad1278c-b416-4522-a2c1-bba5b24aa97b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:18.335911 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dad1278c-b416-4522-a2c1-bba5b24aa97b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:18.336667 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dad1278c-b416-4522-a2c1-bba5b24aa97b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:18.337104 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dad1278c-b416-4522-a2c1-bba5b24aa97b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:18.337531 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dad1278c-b416-4522-a2c1-bba5b24aa97b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:18.399526 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-27452301-6911-4e6a-820c-2754abea772b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:18.400150 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-27452301-6911-4e6a-820c-2754abea772b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:18.402910 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dad1278c-b416-4522-a2c1-bba5b24aa97b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:18.406359 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27452301-6911-4e6a-820c-2754abea772b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:18.406808 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27452301-6911-4e6a-820c-2754abea772b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:18.408323 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27452301-6911-4e6a-820c-2754abea772b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:18.408786 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27452301-6911-4e6a-820c-2754abea772b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:18.411966 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dad1278c-b416-4522-a2c1-bba5b24aa97b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:18.416475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dad1278c-b416-4522-a2c1-bba5b24aa97b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:18.416475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-dad1278c-b416-4522-a2c1-bba5b24aa97b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1332 microversion: 2.20 time: 0.090282 Jun 16 18:07:18.416475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 59/115] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:18 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:18.472838 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-27452301-6911-4e6a-820c-2754abea772b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:18.480611 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-27452301-6911-4e6a-820c-2754abea772b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1237 microversion: 2.1 time: 0.085168 Jun 16 18:07:18.481184 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 57/116] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:18 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:18.556720 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f9d7a68a-6b90-460b-b431-285b217796e3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:18.557329 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f9d7a68a-6b90-460b-b431-285b217796e3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:18.563587 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f9d7a68a-6b90-460b-b431-285b217796e3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:18.564570 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f9d7a68a-6b90-460b-b431-285b217796e3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:18.565341 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f9d7a68a-6b90-460b-b431-285b217796e3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:18.565776 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f9d7a68a-6b90-460b-b431-285b217796e3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:18.628637 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f9d7a68a-6b90-460b-b431-285b217796e3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:18.636184 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f9d7a68a-6b90-460b-b431-285b217796e3 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1232 microversion: 2.1 time: 0.083475 Jun 16 18:07:18.636810 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 60/117] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:18 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1232 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:19.102189 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ad90027e-99c9-4121-9962-48464295743e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:19.102763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ad90027e-99c9-4121-9962-48464295743e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:19.108934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ad90027e-99c9-4121-9962-48464295743e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:19.109628 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ad90027e-99c9-4121-9962-48464295743e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:19.110420 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ad90027e-99c9-4121-9962-48464295743e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:19.111405 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ad90027e-99c9-4121-9962-48464295743e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:19.262714 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ad90027e-99c9-4121-9962-48464295743e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:19.270533 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ad90027e-99c9-4121-9962-48464295743e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.172425 Jun 16 18:07:19.271120 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 58/118] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:19 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:19.341659 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9dbae4a2-9682-4dd2-a27f-83e978081362 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:19.342276 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9dbae4a2-9682-4dd2-a27f-83e978081362 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:19.351457 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9dbae4a2-9682-4dd2-a27f-83e978081362 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:19.352758 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9dbae4a2-9682-4dd2-a27f-83e978081362 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:19.353505 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9dbae4a2-9682-4dd2-a27f-83e978081362 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:19.353942 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9dbae4a2-9682-4dd2-a27f-83e978081362 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:19.433369 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2b57d970-0b73-4edf-bb36-bb16621c1ea5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:19.433959 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2b57d970-0b73-4edf-bb36-bb16621c1ea5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:19.441580 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b57d970-0b73-4edf-bb36-bb16621c1ea5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:19.445546 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b57d970-0b73-4edf-bb36-bb16621c1ea5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:19.445546 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b57d970-0b73-4edf-bb36-bb16621c1ea5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:19.445546 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b57d970-0b73-4edf-bb36-bb16621c1ea5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:19.716143 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2b57d970-0b73-4edf-bb36-bb16621c1ea5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:19.726374 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2b57d970-0b73-4edf-bb36-bb16621c1ea5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:19.727929 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2b57d970-0b73-4edf-bb36-bb16621c1ea5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:19.729105 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2b57d970-0b73-4edf-bb36-bb16621c1ea5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1332 microversion: 2.20 time: 0.299771 Jun 16 18:07:19.729711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 59/119] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:19 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1332 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:07:19.735715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0118cd6a-a2ba-4708-8afa-0cdfd570b157 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:19.736538 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0118cd6a-a2ba-4708-8afa-0cdfd570b157 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:19.748217 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0118cd6a-a2ba-4708-8afa-0cdfd570b157 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:19.748943 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0118cd6a-a2ba-4708-8afa-0cdfd570b157 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:19.749953 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0118cd6a-a2ba-4708-8afa-0cdfd570b157 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:19.752348 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0118cd6a-a2ba-4708-8afa-0cdfd570b157 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:19.832370 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0118cd6a-a2ba-4708-8afa-0cdfd570b157 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:19.842141 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0118cd6a-a2ba-4708-8afa-0cdfd570b157 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1237 microversion: 2.1 time: 0.109970 Jun 16 18:07:19.842718 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 60/120] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:19 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1237 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:19.849042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-958cb62b-0a6f-4173-8fa1-cef8096b3350 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:19.849964 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-958cb62b-0a6f-4173-8fa1-cef8096b3350 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:19.856826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-958cb62b-0a6f-4173-8fa1-cef8096b3350 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:19.857307 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-958cb62b-0a6f-4173-8fa1-cef8096b3350 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:19.859733 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-958cb62b-0a6f-4173-8fa1-cef8096b3350 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:19.860249 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-958cb62b-0a6f-4173-8fa1-cef8096b3350 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:19.876353 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9dbae4a2-9682-4dd2-a27f-83e978081362 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:19.890701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9dbae4a2-9682-4dd2-a27f-83e978081362 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.557036 Jun 16 18:07:19.891288 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 61/121] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:19 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:19.935809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-958cb62b-0a6f-4173-8fa1-cef8096b3350 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:19.938609 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=100 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:19.946557 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-958cb62b-0a6f-4173-8fa1-cef8096b3350 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1288 microversion: 2.1 time: 0.102566 Jun 16 18:07:19.947501 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 61/122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:19 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:20.100419 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-2f5979fa-f311-4579-abff-1adfb12625f8 req-5242f119-e508-440b-acaa-b411df5c8053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d859d92-dab1-47f8-85ba-1e86413ceec9", "name": "network-vif-plugged", "status": "completed", "tag": "cb3429ba-4c67-4253-ae49-1e5ad7f17023"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:20.109091 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-2f5979fa-f311-4579-abff-1adfb12625f8 req-5242f119-e508-440b-acaa-b411df5c8053 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:20.109472 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-2f5979fa-f311-4579-abff-1adfb12625f8 req-5242f119-e508-440b-acaa-b411df5c8053 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:20.121419 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-2f5979fa-f311-4579-abff-1adfb12625f8 req-5242f119-e508-440b-acaa-b411df5c8053 service nova] Creating event network-vif-plugged:cb3429ba-4c67-4253-ae49-1e5ad7f17023 for instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 on hv-cinder-83754 Jun 16 18:07:20.126479 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-2f5979fa-f311-4579-abff-1adfb12625f8 req-5242f119-e508-440b-acaa-b411df5c8053 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233006 Jun 16 18:07:20.128504 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 62/123] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:20.288468 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c2e8054b-2141-403c-87d3-b3bee1afbe85 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:20.289079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c2e8054b-2141-403c-87d3-b3bee1afbe85 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:20.295199 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c2e8054b-2141-403c-87d3-b3bee1afbe85 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:20.295676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c2e8054b-2141-403c-87d3-b3bee1afbe85 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:20.296481 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c2e8054b-2141-403c-87d3-b3bee1afbe85 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:20.296915 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c2e8054b-2141-403c-87d3-b3bee1afbe85 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:20.451040 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c2e8054b-2141-403c-87d3-b3bee1afbe85 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:20.459400 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c2e8054b-2141-403c-87d3-b3bee1afbe85 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.174959 Jun 16 18:07:20.459997 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 62/124] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:20 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:20.748927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dc3334b0-9fbb-4134-b315-cec4903a5a92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:20.749724 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-dc3334b0-9fbb-4134-b315-cec4903a5a92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:20.757800 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc3334b0-9fbb-4134-b315-cec4903a5a92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:20.758343 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc3334b0-9fbb-4134-b315-cec4903a5a92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:20.759193 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc3334b0-9fbb-4134-b315-cec4903a5a92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:20.759811 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc3334b0-9fbb-4134-b315-cec4903a5a92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:20.859436 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dc3334b0-9fbb-4134-b315-cec4903a5a92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:20.862666 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3510c7e6-c76b-4ea2-9247-eb3afa7aed95 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:20.863551 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3510c7e6-c76b-4ea2-9247-eb3afa7aed95 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:20.869210 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:20.869470 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dc3334b0-9fbb-4134-b315-cec4903a5a92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:20.870994 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3510c7e6-c76b-4ea2-9247-eb3afa7aed95 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:20.871521 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dc3334b0-9fbb-4134-b315-cec4903a5a92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:20.872049 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3510c7e6-c76b-4ea2-9247-eb3afa7aed95 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:20.873565 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-dc3334b0-9fbb-4134-b315-cec4903a5a92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1340 microversion: 2.20 time: 0.129448 Jun 16 18:07:20.879312 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3510c7e6-c76b-4ea2-9247-eb3afa7aed95 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:20.880052 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3510c7e6-c76b-4ea2-9247-eb3afa7aed95 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:20.887549 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 63/125] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:20 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1340 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:20.916900 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d96f83b6-c953-4e05-8e0e-e4711c372681 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:20.916900 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d96f83b6-c953-4e05-8e0e-e4711c372681 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:20.930055 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d96f83b6-c953-4e05-8e0e-e4711c372681 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:20.930515 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d96f83b6-c953-4e05-8e0e-e4711c372681 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:20.931650 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d96f83b6-c953-4e05-8e0e-e4711c372681 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:20.936082 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d96f83b6-c953-4e05-8e0e-e4711c372681 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:20.987438 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3510c7e6-c76b-4ea2-9247-eb3afa7aed95 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:20.999399 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3510c7e6-c76b-4ea2-9247-eb3afa7aed95 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1293 microversion: 2.1 time: 0.141124 Jun 16 18:07:21.010280 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 63/126] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:20 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1293 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:21.015309 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9f56ee69-e581-4f3e-80d4-37b9c2e346ed tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:21.015954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9f56ee69-e581-4f3e-80d4-37b9c2e346ed tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:21.023015 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f56ee69-e581-4f3e-80d4-37b9c2e346ed tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:21.023765 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f56ee69-e581-4f3e-80d4-37b9c2e346ed tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:21.027736 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f56ee69-e581-4f3e-80d4-37b9c2e346ed tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:21.027736 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f56ee69-e581-4f3e-80d4-37b9c2e346ed tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:21.105198 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9f56ee69-e581-4f3e-80d4-37b9c2e346ed tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:21.120038 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9f56ee69-e581-4f3e-80d4-37b9c2e346ed tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1296 microversion: 2.1 time: 0.108424 Jun 16 18:07:21.120638 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 64/127] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:21 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:21.149216 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d96f83b6-c953-4e05-8e0e-e4711c372681 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:21.158209 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d96f83b6-c953-4e05-8e0e-e4711c372681 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.252642 Jun 16 18:07:21.160070 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 64/128] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:20 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:21.476402 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-af9ae827-d78d-4b3e-a8fa-3879fe5ac75c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:21.477017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-af9ae827-d78d-4b3e-a8fa-3879fe5ac75c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:21.486116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-af9ae827-d78d-4b3e-a8fa-3879fe5ac75c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:21.488927 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-af9ae827-d78d-4b3e-a8fa-3879fe5ac75c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:21.492303 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-af9ae827-d78d-4b3e-a8fa-3879fe5ac75c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:21.492910 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-af9ae827-d78d-4b3e-a8fa-3879fe5ac75c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:21.760508 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-af9ae827-d78d-4b3e-a8fa-3879fe5ac75c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:21.770304 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-af9ae827-d78d-4b3e-a8fa-3879fe5ac75c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.297926 Jun 16 18:07:21.771196 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 65/129] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:21 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:21.895395 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1ac5e538-f20c-40aa-8dd2-9e66f88ba5eb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:21.896242 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1ac5e538-f20c-40aa-8dd2-9e66f88ba5eb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:21.921602 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1ac5e538-f20c-40aa-8dd2-9e66f88ba5eb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:21.941117 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1ac5e538-f20c-40aa-8dd2-9e66f88ba5eb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:21.943411 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1ac5e538-f20c-40aa-8dd2-9e66f88ba5eb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:21.947812 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1ac5e538-f20c-40aa-8dd2-9e66f88ba5eb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:22.019635 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9483d15b-a34f-48ad-86d7-fc92e95b6c72 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:22.019945 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9483d15b-a34f-48ad-86d7-fc92e95b6c72 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:22.040354 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9483d15b-a34f-48ad-86d7-fc92e95b6c72 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:22.040807 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9483d15b-a34f-48ad-86d7-fc92e95b6c72 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:22.043869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9483d15b-a34f-48ad-86d7-fc92e95b6c72 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:22.047625 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9483d15b-a34f-48ad-86d7-fc92e95b6c72 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:22.137534 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1ac5e538-f20c-40aa-8dd2-9e66f88ba5eb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:22.162522 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9483d15b-a34f-48ad-86d7-fc92e95b6c72 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:22.176876 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1ac5e538-f20c-40aa-8dd2-9e66f88ba5eb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:22.191759 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1ac5e538-f20c-40aa-8dd2-9e66f88ba5eb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:22.191759 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1ac5e538-f20c-40aa-8dd2-9e66f88ba5eb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1338 microversion: 2.20 time: 0.291503 Jun 16 18:07:22.191759 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 65/130] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:21 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1338 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:22.192254 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9483d15b-a34f-48ad-86d7-fc92e95b6c72 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1301 microversion: 2.1 time: 0.166875 Jun 16 18:07:22.192254 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 66/131] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:22 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1301 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:22.204662 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d7f8805a-3bd4-430a-a0a5-306aa9a9e342 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:22.205438 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d7f8805a-3bd4-430a-a0a5-306aa9a9e342 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:22.215513 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d343a7b8-92c4-4616-8320-542c2a22f391 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:22.216349 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d343a7b8-92c4-4616-8320-542c2a22f391 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:22.219632 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d7f8805a-3bd4-430a-a0a5-306aa9a9e342 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:22.225832 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d7f8805a-3bd4-430a-a0a5-306aa9a9e342 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:22.225832 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d7f8805a-3bd4-430a-a0a5-306aa9a9e342 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:22.225832 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d7f8805a-3bd4-430a-a0a5-306aa9a9e342 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:22.235524 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d343a7b8-92c4-4616-8320-542c2a22f391 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:22.239466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d343a7b8-92c4-4616-8320-542c2a22f391 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:22.241711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d343a7b8-92c4-4616-8320-542c2a22f391 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:22.242359 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d343a7b8-92c4-4616-8320-542c2a22f391 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:22.344430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d7f8805a-3bd4-430a-a0a5-306aa9a9e342 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:22.355278 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d7f8805a-3bd4-430a-a0a5-306aa9a9e342 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1294 microversion: 2.1 time: 0.169729 Jun 16 18:07:22.375956 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 66/132] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:22 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1294 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:22.390998 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-2c54cdc2-621e-4bee-9c58-10b4b56034db req-a2550a32-be66-4f19-9fa0-45cca093ac06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e8a4704-5fc6-45e0-901c-a972411b4d0c", "name": "network-vif-plugged", "status": "completed", "tag": "4dd40206-bc4d-4054-80c9-ae713a416d7a"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:22.416662 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-2c54cdc2-621e-4bee-9c58-10b4b56034db req-a2550a32-be66-4f19-9fa0-45cca093ac06 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:22.424258 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-2c54cdc2-621e-4bee-9c58-10b4b56034db req-a2550a32-be66-4f19-9fa0-45cca093ac06 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:22.451345 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-2c54cdc2-621e-4bee-9c58-10b4b56034db req-a2550a32-be66-4f19-9fa0-45cca093ac06 service nova] Creating event network-vif-plugged:4dd40206-bc4d-4054-80c9-ae713a416d7a for instance 5e8a4704-5fc6-45e0-901c-a972411b4d0c on hv-cinder-83754 Jun 16 18:07:22.466092 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-2c54cdc2-621e-4bee-9c58-10b4b56034db req-a2550a32-be66-4f19-9fa0-45cca093ac06 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085658 Jun 16 18:07:22.469111 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 67/133] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:22.607131 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d343a7b8-92c4-4616-8320-542c2a22f391 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:22.629612 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d343a7b8-92c4-4616-8320-542c2a22f391 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.438016 Jun 16 18:07:22.636334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 67/134] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:22 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:22.787255 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f632184f-2be8-4d46-87d8-5c8f5da0672d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:22.787995 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f632184f-2be8-4d46-87d8-5c8f5da0672d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:22.789905 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:22.794984 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f632184f-2be8-4d46-87d8-5c8f5da0672d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:22.795451 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f632184f-2be8-4d46-87d8-5c8f5da0672d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:22.796209 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f632184f-2be8-4d46-87d8-5c8f5da0672d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:22.796644 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f632184f-2be8-4d46-87d8-5c8f5da0672d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:23.038280 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f632184f-2be8-4d46-87d8-5c8f5da0672d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:23.054917 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f632184f-2be8-4d46-87d8-5c8f5da0672d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.267240 Jun 16 18:07:23.055321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 68/135] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:22 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:23.205441 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8de06b2b-15f3-4dd9-a4d0-19206b391e77 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:23.205441 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8de06b2b-15f3-4dd9-a4d0-19206b391e77 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:23.213306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8de06b2b-15f3-4dd9-a4d0-19206b391e77 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:23.214054 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8de06b2b-15f3-4dd9-a4d0-19206b391e77 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:23.214944 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8de06b2b-15f3-4dd9-a4d0-19206b391e77 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:23.215301 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8de06b2b-15f3-4dd9-a4d0-19206b391e77 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:23.216286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ee378132-218a-4482-9895-d9c13c558da9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:23.218324 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ee378132-218a-4482-9895-d9c13c558da9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:23.228473 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ee378132-218a-4482-9895-d9c13c558da9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:23.229239 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ee378132-218a-4482-9895-d9c13c558da9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:23.230278 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ee378132-218a-4482-9895-d9c13c558da9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:23.230919 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ee378132-218a-4482-9895-d9c13c558da9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:23.342786 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ee378132-218a-4482-9895-d9c13c558da9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:23.349026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ee378132-218a-4482-9895-d9c13c558da9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1299 microversion: 2.1 time: 0.144364 Jun 16 18:07:23.349618 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 69/136] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:23 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:23.378301 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4ad899ca-653f-4d09-8649-34a5b8d02f5d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:23.379141 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4ad899ca-653f-4d09-8649-34a5b8d02f5d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:23.387176 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4ad899ca-653f-4d09-8649-34a5b8d02f5d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:23.388426 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4ad899ca-653f-4d09-8649-34a5b8d02f5d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:23.389223 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4ad899ca-653f-4d09-8649-34a5b8d02f5d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:23.389656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4ad899ca-653f-4d09-8649-34a5b8d02f5d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:23.396734 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=100 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:23.418223 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8de06b2b-15f3-4dd9-a4d0-19206b391e77 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:23.441495 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8de06b2b-15f3-4dd9-a4d0-19206b391e77 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:23.451256 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8de06b2b-15f3-4dd9-a4d0-19206b391e77 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:23.454274 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8de06b2b-15f3-4dd9-a4d0-19206b391e77 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.257508 Jun 16 18:07:23.456939 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 68/137] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:23 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:23.595624 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4ad899ca-653f-4d09-8649-34a5b8d02f5d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:23.600109 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4ad899ca-653f-4d09-8649-34a5b8d02f5d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.225808 Jun 16 18:07:23.601111 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 70/138] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:23 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:23.658420 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3b337500-ed2f-47be-9138-8392d91189ff tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:23.658420 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3b337500-ed2f-47be-9138-8392d91189ff tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:23.668763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3b337500-ed2f-47be-9138-8392d91189ff tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:23.670057 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3b337500-ed2f-47be-9138-8392d91189ff tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:23.674352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3b337500-ed2f-47be-9138-8392d91189ff tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:23.679170 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3b337500-ed2f-47be-9138-8392d91189ff tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:23.999913 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3b337500-ed2f-47be-9138-8392d91189ff tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:24.014216 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3b337500-ed2f-47be-9138-8392d91189ff tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.366492 Jun 16 18:07:24.014850 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 69/139] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:23 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:24.071915 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-94a197a1-1319-4e80-92e5-f01b05f3dce2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:24.073318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-94a197a1-1319-4e80-92e5-f01b05f3dce2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:24.080643 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-94a197a1-1319-4e80-92e5-f01b05f3dce2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:24.081156 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-94a197a1-1319-4e80-92e5-f01b05f3dce2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:24.087598 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-94a197a1-1319-4e80-92e5-f01b05f3dce2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:24.087598 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-94a197a1-1319-4e80-92e5-f01b05f3dce2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:24.310111 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-94a197a1-1319-4e80-92e5-f01b05f3dce2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:24.320332 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-94a197a1-1319-4e80-92e5-f01b05f3dce2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.253059 Jun 16 18:07:24.321469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 71/140] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:24 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:24.367842 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a99ed22e-dcf5-4011-8560-9f37a2bdb702 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:24.368446 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a99ed22e-dcf5-4011-8560-9f37a2bdb702 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:24.374993 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a99ed22e-dcf5-4011-8560-9f37a2bdb702 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:24.375469 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a99ed22e-dcf5-4011-8560-9f37a2bdb702 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:24.376247 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a99ed22e-dcf5-4011-8560-9f37a2bdb702 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:24.376686 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a99ed22e-dcf5-4011-8560-9f37a2bdb702 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:24.476054 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f772771c-a6f2-4584-bf7a-e469e5e688b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:24.476674 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f772771c-a6f2-4584-bf7a-e469e5e688b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:24.487511 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f772771c-a6f2-4584-bf7a-e469e5e688b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:24.496615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f772771c-a6f2-4584-bf7a-e469e5e688b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:24.497575 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f772771c-a6f2-4584-bf7a-e469e5e688b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:24.498282 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f772771c-a6f2-4584-bf7a-e469e5e688b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:24.556500 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a99ed22e-dcf5-4011-8560-9f37a2bdb702 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:24.564838 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a99ed22e-dcf5-4011-8560-9f37a2bdb702 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.202357 Jun 16 18:07:24.566856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 70/141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:24 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:24.572087 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-a8b959e5-e184-4e5c-8257-aeb4b8cdd09e req-802548f4-d1ae-4d7c-bbe1-41108e311890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91383053-09e9-4294-86b1-ba106512b82f", "name": "network-vif-plugged", "status": "completed", "tag": "8f397e6e-f2ca-4cbf-a4ea-14613d40280b"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:24.587847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-a8b959e5-e184-4e5c-8257-aeb4b8cdd09e req-802548f4-d1ae-4d7c-bbe1-41108e311890 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:24.587847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-a8b959e5-e184-4e5c-8257-aeb4b8cdd09e req-802548f4-d1ae-4d7c-bbe1-41108e311890 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:24.619968 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-a8b959e5-e184-4e5c-8257-aeb4b8cdd09e req-802548f4-d1ae-4d7c-bbe1-41108e311890 service nova] Creating event network-vif-plugged:8f397e6e-f2ca-4cbf-a4ea-14613d40280b for instance 91383053-09e9-4294-86b1-ba106512b82f on hv-cinder-83754 Jun 16 18:07:24.633115 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-a8b959e5-e184-4e5c-8257-aeb4b8cdd09e req-802548f4-d1ae-4d7c-bbe1-41108e311890 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064514 Jun 16 18:07:24.634158 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 71/142] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:24.640962 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-19c31ff1-97d4-49c3-abdc-2ed7b1bfe0e1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:24.642030 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-19c31ff1-97d4-49c3-abdc-2ed7b1bfe0e1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:24.653725 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-19c31ff1-97d4-49c3-abdc-2ed7b1bfe0e1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:24.654235 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-19c31ff1-97d4-49c3-abdc-2ed7b1bfe0e1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:24.655523 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-19c31ff1-97d4-49c3-abdc-2ed7b1bfe0e1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:24.655971 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-19c31ff1-97d4-49c3-abdc-2ed7b1bfe0e1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:24.927081 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f772771c-a6f2-4584-bf7a-e469e5e688b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:24.955563 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f772771c-a6f2-4584-bf7a-e469e5e688b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:24.959029 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f772771c-a6f2-4584-bf7a-e469e5e688b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:24.970055 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f772771c-a6f2-4584-bf7a-e469e5e688b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.499565 Jun 16 18:07:24.971842 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 72/143] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:24 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:24.981106 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-19c31ff1-97d4-49c3-abdc-2ed7b1bfe0e1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:24.989705 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-19c31ff1-97d4-49c3-abdc-2ed7b1bfe0e1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.353052 Jun 16 18:07:24.991763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 72/144] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:24 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:25.033161 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e53cdda8-183b-4ea3-9600-97afa1f0d65a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:25.033840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e53cdda8-183b-4ea3-9600-97afa1f0d65a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:25.043595 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e53cdda8-183b-4ea3-9600-97afa1f0d65a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:25.044050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e53cdda8-183b-4ea3-9600-97afa1f0d65a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:25.046583 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e53cdda8-183b-4ea3-9600-97afa1f0d65a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:25.047087 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e53cdda8-183b-4ea3-9600-97afa1f0d65a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:25.353816 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a709f85b-ce95-4e83-b3f8-f33f2ca3606d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:25.373365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a709f85b-ce95-4e83-b3f8-f33f2ca3606d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:25.400106 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a709f85b-ce95-4e83-b3f8-f33f2ca3606d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:25.403786 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a709f85b-ce95-4e83-b3f8-f33f2ca3606d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:25.411506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a709f85b-ce95-4e83-b3f8-f33f2ca3606d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:25.412371 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a709f85b-ce95-4e83-b3f8-f33f2ca3606d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:25.415683 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e53cdda8-183b-4ea3-9600-97afa1f0d65a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:25.437870 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e53cdda8-183b-4ea3-9600-97afa1f0d65a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.406586 Jun 16 18:07:25.439307 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 73/145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:25 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:25.450620 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-cb57fa82-c2b4-416b-bdae-8fb79cc814f0 req-a25e6010-c49e-4ae8-aa91-f536b480f91f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "279175ca-aad1-40da-a191-4712cbd17771", "tag": "d3e274fe-5d79-4687-9f75-5a8fd858ef61"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:25.474163 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-cb57fa82-c2b4-416b-bdae-8fb79cc814f0 req-a25e6010-c49e-4ae8-aa91-f536b480f91f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:25.477195 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-cb57fa82-c2b4-416b-bdae-8fb79cc814f0 req-a25e6010-c49e-4ae8-aa91-f536b480f91f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:25.502027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-cb57fa82-c2b4-416b-bdae-8fb79cc814f0 req-a25e6010-c49e-4ae8-aa91-f536b480f91f service nova] Creating event network-changed:d3e274fe-5d79-4687-9f75-5a8fd858ef61 for instance 279175ca-aad1-40da-a191-4712cbd17771 on hv-cinder-83754 Jun 16 18:07:25.512462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-cb57fa82-c2b4-416b-bdae-8fb79cc814f0 req-a25e6010-c49e-4ae8-aa91-f536b480f91f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071030 Jun 16 18:07:25.513404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 74/146] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:25.586276 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-143c060d-c3d8-43b6-808b-dd01d14eefea tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:25.587304 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-143c060d-c3d8-43b6-808b-dd01d14eefea tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:25.596710 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-143c060d-c3d8-43b6-808b-dd01d14eefea tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:25.597707 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-143c060d-c3d8-43b6-808b-dd01d14eefea tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:25.599466 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-143c060d-c3d8-43b6-808b-dd01d14eefea tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:25.600123 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-143c060d-c3d8-43b6-808b-dd01d14eefea tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:25.689412 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a709f85b-ce95-4e83-b3f8-f33f2ca3606d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:25.702132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a709f85b-ce95-4e83-b3f8-f33f2ca3606d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1320 microversion: 2.1 time: 0.359089 Jun 16 18:07:25.703209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 73/147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:25 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1320 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:25.850569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-ef181eae-df2e-4af6-babe-e4dbed231991 req-33023119-7757-457d-aef9-2f4698e756d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1134706f-4520-434d-877f-bc6465b3e282", "tag": "41a992ba-4fda-42d8-a121-3c7c2f9e6d3d"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:25.864527 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-ef181eae-df2e-4af6-babe-e4dbed231991 req-33023119-7757-457d-aef9-2f4698e756d4 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:25.865302 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-ef181eae-df2e-4af6-babe-e4dbed231991 req-33023119-7757-457d-aef9-2f4698e756d4 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:25.886889 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-ef181eae-df2e-4af6-babe-e4dbed231991 req-33023119-7757-457d-aef9-2f4698e756d4 service nova] Creating event network-changed:41a992ba-4fda-42d8-a121-3c7c2f9e6d3d for instance 1134706f-4520-434d-877f-bc6465b3e282 on hv-cinder-83754 Jun 16 18:07:25.894630 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-ef181eae-df2e-4af6-babe-e4dbed231991 req-33023119-7757-457d-aef9-2f4698e756d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048904 Jun 16 18:07:25.896077 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 74/148] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:25.931063 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-143c060d-c3d8-43b6-808b-dd01d14eefea tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:25.945841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-143c060d-c3d8-43b6-808b-dd01d14eefea tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.360009 Jun 16 18:07:25.958238 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 75/149] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:25 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:25.995311 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d068cea2-ba2c-4247-8517-7b34bcfe94a2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:25.997462 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d068cea2-ba2c-4247-8517-7b34bcfe94a2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:26.010040 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d068cea2-ba2c-4247-8517-7b34bcfe94a2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:26.011399 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d068cea2-ba2c-4247-8517-7b34bcfe94a2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:26.012777 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5d82b6dc-89e3-452b-a5d1-cd1bd07c1ec6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:26.019050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5d82b6dc-89e3-452b-a5d1-cd1bd07c1ec6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:26.023776 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d068cea2-ba2c-4247-8517-7b34bcfe94a2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:26.028365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d068cea2-ba2c-4247-8517-7b34bcfe94a2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:26.033217 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5d82b6dc-89e3-452b-a5d1-cd1bd07c1ec6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:26.034181 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5d82b6dc-89e3-452b-a5d1-cd1bd07c1ec6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:26.036808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5d82b6dc-89e3-452b-a5d1-cd1bd07c1ec6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:26.040816 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5d82b6dc-89e3-452b-a5d1-cd1bd07c1ec6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:26.512900 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d068cea2-ba2c-4247-8517-7b34bcfe94a2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:26.529523 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d068cea2-ba2c-4247-8517-7b34bcfe94a2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:26.531105 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d068cea2-ba2c-4247-8517-7b34bcfe94a2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:26.532651 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d068cea2-ba2c-4247-8517-7b34bcfe94a2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.544749 Jun 16 18:07:26.533375 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 75/150] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:25 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:26.537281 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5d82b6dc-89e3-452b-a5d1-cd1bd07c1ec6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:26.548676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-45871741-ec1d-4d91-8eb9-82fec90f9c99 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:26.549194 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-45871741-ec1d-4d91-8eb9-82fec90f9c99 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:26.562429 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5d82b6dc-89e3-452b-a5d1-cd1bd07c1ec6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.554643 Jun 16 18:07:26.563072 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-45871741-ec1d-4d91-8eb9-82fec90f9c99 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:26.563923 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-45871741-ec1d-4d91-8eb9-82fec90f9c99 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:26.564924 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-45871741-ec1d-4d91-8eb9-82fec90f9c99 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:26.574905 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 76/151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:26 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:26.577027 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-45871741-ec1d-4d91-8eb9-82fec90f9c99 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:26.721244 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-95004af1-931c-4259-9e86-5be32e7abdf0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:26.721863 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-95004af1-931c-4259-9e86-5be32e7abdf0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:26.741098 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-95004af1-931c-4259-9e86-5be32e7abdf0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:26.744329 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-95004af1-931c-4259-9e86-5be32e7abdf0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:26.745969 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-95004af1-931c-4259-9e86-5be32e7abdf0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:26.746640 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-95004af1-931c-4259-9e86-5be32e7abdf0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:27.286511 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-45871741-ec1d-4d91-8eb9-82fec90f9c99 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:27.297533 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-45871741-ec1d-4d91-8eb9-82fec90f9c99 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.763097 Jun 16 18:07:27.299252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 76/152] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:26 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:27.306169 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b4a18eef-5fff-4768-ad98-620f4ef86ce8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:27.307085 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b4a18eef-5fff-4768-ad98-620f4ef86ce8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:27.315088 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-95004af1-931c-4259-9e86-5be32e7abdf0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:27.325509 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b4a18eef-5fff-4768-ad98-620f4ef86ce8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:27.325509 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b4a18eef-5fff-4768-ad98-620f4ef86ce8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:27.325509 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b4a18eef-5fff-4768-ad98-620f4ef86ce8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:27.325509 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b4a18eef-5fff-4768-ad98-620f4ef86ce8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:27.325855 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-95004af1-931c-4259-9e86-5be32e7abdf0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1514 microversion: 2.1 time: 0.608822 Jun 16 18:07:27.325947 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 77/153] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:26 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1514 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:27.344621 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3e2bc368-3852-4bc5-9011-806aee6c9271 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:27.346133 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3e2bc368-3852-4bc5-9011-806aee6c9271 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:27.355767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e2bc368-3852-4bc5-9011-806aee6c9271 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:27.356611 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e2bc368-3852-4bc5-9011-806aee6c9271 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:27.357619 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e2bc368-3852-4bc5-9011-806aee6c9271 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:27.358236 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e2bc368-3852-4bc5-9011-806aee6c9271 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:27.467269 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-3e2bc368-3852-4bc5-9011-806aee6c9271 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lazy-loading 'flavor' on Instance uuid 5e8a4704-5fc6-45e0-901c-a972411b4d0c {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:07:27.610373 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b4a18eef-5fff-4768-ad98-620f4ef86ce8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:27.618739 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b4a18eef-5fff-4768-ad98-620f4ef86ce8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.318159 Jun 16 18:07:27.619313 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 77/154] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:27 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:27.623932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c69e8ad0-2d9d-45dd-810f-9c8eef99876f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:27.624528 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c69e8ad0-2d9d-45dd-810f-9c8eef99876f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:27.631453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c69e8ad0-2d9d-45dd-810f-9c8eef99876f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:27.631900 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c69e8ad0-2d9d-45dd-810f-9c8eef99876f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:27.632665 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c69e8ad0-2d9d-45dd-810f-9c8eef99876f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:27.633091 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c69e8ad0-2d9d-45dd-810f-9c8eef99876f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:27.794142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c69e8ad0-2d9d-45dd-810f-9c8eef99876f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:27.803276 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c69e8ad0-2d9d-45dd-810f-9c8eef99876f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:27.804904 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c69e8ad0-2d9d-45dd-810f-9c8eef99876f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:27.806024 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c69e8ad0-2d9d-45dd-810f-9c8eef99876f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.185771 Jun 16 18:07:27.806738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 78/155] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:27 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:27.811543 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-66a832bb-8d8a-4c42-ba3f-cfe971f0c061 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:27.815794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-66a832bb-8d8a-4c42-ba3f-cfe971f0c061 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:27.824839 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-66a832bb-8d8a-4c42-ba3f-cfe971f0c061 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:27.825531 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-66a832bb-8d8a-4c42-ba3f-cfe971f0c061 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:27.826251 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-66a832bb-8d8a-4c42-ba3f-cfe971f0c061 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:27.826735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-66a832bb-8d8a-4c42-ba3f-cfe971f0c061 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:27.935818 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3e2bc368-3852-4bc5-9011-806aee6c9271 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "POST /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c/action" status: 200 len: 32 microversion: 2.1 time: 0.596216 Jun 16 18:07:27.936650 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 78/156] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:07:27 2022] POST /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c/action => generated 32 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:07:27.942880 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-96433628-fc9b-4676-89d8-2e9f15118df7 req-00a7a2e4-f8b6-4f98-bfc6-a43ab53921ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77efc8cd-421f-42e8-98e5-cb9e269e9e6e", "tag": "8557bd0c-ae73-4af6-b470-984e296cdd16"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:27.952860 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-96433628-fc9b-4676-89d8-2e9f15118df7 req-00a7a2e4-f8b6-4f98-bfc6-a43ab53921ab service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:27.952860 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-96433628-fc9b-4676-89d8-2e9f15118df7 req-00a7a2e4-f8b6-4f98-bfc6-a43ab53921ab service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:27.964434 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-96433628-fc9b-4676-89d8-2e9f15118df7 req-00a7a2e4-f8b6-4f98-bfc6-a43ab53921ab service nova] Creating event network-changed:8557bd0c-ae73-4af6-b470-984e296cdd16 for instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e on hv-cinder-83754 Jun 16 18:07:27.969242 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-96433628-fc9b-4676-89d8-2e9f15118df7 req-00a7a2e4-f8b6-4f98-bfc6-a43ab53921ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030957 Jun 16 18:07:27.969852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 79/157] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:27.976050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-13421159-32c1-473f-926b-138a311742fa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:27.976754 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-13421159-32c1-473f-926b-138a311742fa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:27.985603 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-66a832bb-8d8a-4c42-ba3f-cfe971f0c061 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:27.985779 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-13421159-32c1-473f-926b-138a311742fa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:27.985779 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-13421159-32c1-473f-926b-138a311742fa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:27.985779 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-13421159-32c1-473f-926b-138a311742fa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:27.986183 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-13421159-32c1-473f-926b-138a311742fa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:27.987934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=100 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:27.997656 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-66a832bb-8d8a-4c42-ba3f-cfe971f0c061 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.189648 Jun 16 18:07:28.009990 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 79/158] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:27 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:28.164930 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-13421159-32c1-473f-926b-138a311742fa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:28.173385 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-13421159-32c1-473f-926b-138a311742fa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.202296 Jun 16 18:07:28.174159 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 80/159] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:27 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:28.316464 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ec5d7840-2206-4ea8-8909-25ebd3a83052 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:28.318132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ec5d7840-2206-4ea8-8909-25ebd3a83052 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:28.324406 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ec5d7840-2206-4ea8-8909-25ebd3a83052 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:28.324848 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ec5d7840-2206-4ea8-8909-25ebd3a83052 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:28.325682 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ec5d7840-2206-4ea8-8909-25ebd3a83052 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:28.326111 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ec5d7840-2206-4ea8-8909-25ebd3a83052 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:28.464908 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ec5d7840-2206-4ea8-8909-25ebd3a83052 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:28.473657 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ec5d7840-2206-4ea8-8909-25ebd3a83052 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.160942 Jun 16 18:07:28.483505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 80/160] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:28 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:28.637100 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e29c5c1d-c70e-42f6-922c-233a97911228 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:28.637812 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e29c5c1d-c70e-42f6-922c-233a97911228 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:28.644935 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e29c5c1d-c70e-42f6-922c-233a97911228 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:28.645595 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e29c5c1d-c70e-42f6-922c-233a97911228 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:28.646764 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e29c5c1d-c70e-42f6-922c-233a97911228 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:28.647195 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e29c5c1d-c70e-42f6-922c-233a97911228 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:28.827544 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a33fec37-66f2-494c-bf33-ffd2ab7b8067 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:28.828074 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a33fec37-66f2-494c-bf33-ffd2ab7b8067 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:28.838243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a33fec37-66f2-494c-bf33-ffd2ab7b8067 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:28.839617 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a33fec37-66f2-494c-bf33-ffd2ab7b8067 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:28.841005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a33fec37-66f2-494c-bf33-ffd2ab7b8067 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:28.841686 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a33fec37-66f2-494c-bf33-ffd2ab7b8067 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:28.894791 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e29c5c1d-c70e-42f6-922c-233a97911228 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:28.906759 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e29c5c1d-c70e-42f6-922c-233a97911228 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.273838 Jun 16 18:07:28.909325 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 81/161] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:28 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:29.016625 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-81b5b247-5b42-42f0-949e-ddd5cda9067a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:29.017304 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-81b5b247-5b42-42f0-949e-ddd5cda9067a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:29.023601 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-81b5b247-5b42-42f0-949e-ddd5cda9067a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:29.023980 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-81b5b247-5b42-42f0-949e-ddd5cda9067a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:29.027037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a33fec37-66f2-494c-bf33-ffd2ab7b8067 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:29.031322 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-81b5b247-5b42-42f0-949e-ddd5cda9067a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:29.031794 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-81b5b247-5b42-42f0-949e-ddd5cda9067a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:29.040977 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a33fec37-66f2-494c-bf33-ffd2ab7b8067 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:29.042508 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a33fec37-66f2-494c-bf33-ffd2ab7b8067 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:29.043665 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a33fec37-66f2-494c-bf33-ffd2ab7b8067 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.221829 Jun 16 18:07:29.044229 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 81/162] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:28 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:07:29.185156 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-81b5b247-5b42-42f0-949e-ddd5cda9067a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:29.191416 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ef27da3c-3d20-4630-9127-ed0cb0c203ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:29.192022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ef27da3c-3d20-4630-9127-ed0cb0c203ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:29.193267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-81b5b247-5b42-42f0-949e-ddd5cda9067a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.180717 Jun 16 18:07:29.193851 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 82/163] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:29 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:29.198946 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ef27da3c-3d20-4630-9127-ed0cb0c203ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:29.199347 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ef27da3c-3d20-4630-9127-ed0cb0c203ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:29.200269 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ef27da3c-3d20-4630-9127-ed0cb0c203ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:29.200698 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ef27da3c-3d20-4630-9127-ed0cb0c203ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:29.354410 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ef27da3c-3d20-4630-9127-ed0cb0c203ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:29.362258 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ef27da3c-3d20-4630-9127-ed0cb0c203ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.174844 Jun 16 18:07:29.362910 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 82/164] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:29 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:29.494962 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-935f0f59-ae34-454c-928f-fbd2568c9a57 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:29.494962 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-935f0f59-ae34-454c-928f-fbd2568c9a57 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:29.506484 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-935f0f59-ae34-454c-928f-fbd2568c9a57 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:29.507267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-935f0f59-ae34-454c-928f-fbd2568c9a57 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:29.508648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-935f0f59-ae34-454c-928f-fbd2568c9a57 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:29.509377 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-935f0f59-ae34-454c-928f-fbd2568c9a57 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:29.673124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-935f0f59-ae34-454c-928f-fbd2568c9a57 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:29.681160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-935f0f59-ae34-454c-928f-fbd2568c9a57 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1315 microversion: 2.1 time: 0.193811 Jun 16 18:07:29.681734 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 83/165] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:29 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:29.924724 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d5e391db-39d1-4aa7-9958-379d46a52251 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:29.925327 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d5e391db-39d1-4aa7-9958-379d46a52251 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:29.931803 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d5e391db-39d1-4aa7-9958-379d46a52251 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:29.932255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d5e391db-39d1-4aa7-9958-379d46a52251 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:29.933000 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d5e391db-39d1-4aa7-9958-379d46a52251 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:29.933430 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d5e391db-39d1-4aa7-9958-379d46a52251 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:30.062051 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-544c8b7c-5e6f-4d1a-8c40-270980c7a34e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:30.062934 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-544c8b7c-5e6f-4d1a-8c40-270980c7a34e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:30.070850 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-544c8b7c-5e6f-4d1a-8c40-270980c7a34e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:30.071297 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-544c8b7c-5e6f-4d1a-8c40-270980c7a34e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:30.072084 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-544c8b7c-5e6f-4d1a-8c40-270980c7a34e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:30.072538 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-544c8b7c-5e6f-4d1a-8c40-270980c7a34e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:30.079285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d5e391db-39d1-4aa7-9958-379d46a52251 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:30.100885 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d5e391db-39d1-4aa7-9958-379d46a52251 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.179800 Jun 16 18:07:30.107761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 83/166] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:29 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:30.211436 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6fd23533-eea0-4d3a-98d7-9e23c711cd31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:30.212417 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6fd23533-eea0-4d3a-98d7-9e23c711cd31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:30.219140 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6fd23533-eea0-4d3a-98d7-9e23c711cd31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:30.219730 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6fd23533-eea0-4d3a-98d7-9e23c711cd31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:30.220578 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6fd23533-eea0-4d3a-98d7-9e23c711cd31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:30.221192 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6fd23533-eea0-4d3a-98d7-9e23c711cd31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:30.248327 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-544c8b7c-5e6f-4d1a-8c40-270980c7a34e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:30.259745 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-544c8b7c-5e6f-4d1a-8c40-270980c7a34e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:30.262769 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-544c8b7c-5e6f-4d1a-8c40-270980c7a34e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:30.267239 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-544c8b7c-5e6f-4d1a-8c40-270980c7a34e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.205827 Jun 16 18:07:30.267239 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 84/167] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:30 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:30.383434 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-09954cf3-f3db-4251-8aa7-d91119e9a964 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:30.384539 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-09954cf3-f3db-4251-8aa7-d91119e9a964 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:30.393943 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-09954cf3-f3db-4251-8aa7-d91119e9a964 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:30.394785 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-09954cf3-f3db-4251-8aa7-d91119e9a964 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:30.397337 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-09954cf3-f3db-4251-8aa7-d91119e9a964 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:30.397959 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-09954cf3-f3db-4251-8aa7-d91119e9a964 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:30.434020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6fd23533-eea0-4d3a-98d7-9e23c711cd31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:30.440302 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6fd23533-eea0-4d3a-98d7-9e23c711cd31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.232845 Jun 16 18:07:30.441281 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 84/168] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:30 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:30.606997 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-09954cf3-f3db-4251-8aa7-d91119e9a964 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:30.612912 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-09954cf3-f3db-4251-8aa7-d91119e9a964 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.236350 Jun 16 18:07:30.613493 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 85/169] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:30 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:30.699629 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-4560ec88-1e9a-4bea-a65a-0a6a4f336f11 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:30.700350 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-4560ec88-1e9a-4bea-a65a-0a6a4f336f11 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:30.713940 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4560ec88-1e9a-4bea-a65a-0a6a4f336f11 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:30.714250 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4560ec88-1e9a-4bea-a65a-0a6a4f336f11 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:30.715052 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4560ec88-1e9a-4bea-a65a-0a6a4f336f11 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:30.715498 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4560ec88-1e9a-4bea-a65a-0a6a4f336f11 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:30.871278 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4560ec88-1e9a-4bea-a65a-0a6a4f336f11 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:30.879170 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-4560ec88-1e9a-4bea-a65a-0a6a4f336f11 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1501 microversion: 2.1 time: 0.183751 Jun 16 18:07:30.879790 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 85/170] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:30 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:31.118555 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d5cfb41b-8a7e-46d0-bc00-799eed81a14a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:31.119460 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d5cfb41b-8a7e-46d0-bc00-799eed81a14a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:31.125578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d5cfb41b-8a7e-46d0-bc00-799eed81a14a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:31.126263 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d5cfb41b-8a7e-46d0-bc00-799eed81a14a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:31.127024 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d5cfb41b-8a7e-46d0-bc00-799eed81a14a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:31.127479 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d5cfb41b-8a7e-46d0-bc00-799eed81a14a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:31.132396 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:31.296995 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-76e8a2ea-f29f-4822-acf9-447de053f5b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:31.301462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d5cfb41b-8a7e-46d0-bc00-799eed81a14a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:31.307311 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-76e8a2ea-f29f-4822-acf9-447de053f5b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:31.319654 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d5cfb41b-8a7e-46d0-bc00-799eed81a14a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.201735 Jun 16 18:07:31.320821 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 86/171] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:31 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:31.323065 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-76e8a2ea-f29f-4822-acf9-447de053f5b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:31.323788 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-76e8a2ea-f29f-4822-acf9-447de053f5b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:31.324675 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-76e8a2ea-f29f-4822-acf9-447de053f5b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:31.325178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-76e8a2ea-f29f-4822-acf9-447de053f5b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:31.461519 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-39db8169-e20a-4d28-88cc-fa90232dbf9f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:31.464412 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-39db8169-e20a-4d28-88cc-fa90232dbf9f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:31.473815 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-39db8169-e20a-4d28-88cc-fa90232dbf9f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:31.474646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-39db8169-e20a-4d28-88cc-fa90232dbf9f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:31.476222 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-39db8169-e20a-4d28-88cc-fa90232dbf9f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:31.477333 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-39db8169-e20a-4d28-88cc-fa90232dbf9f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:31.520088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-76e8a2ea-f29f-4822-acf9-447de053f5b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:31.529837 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-76e8a2ea-f29f-4822-acf9-447de053f5b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:31.531622 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-76e8a2ea-f29f-4822-acf9-447de053f5b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:31.543814 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-76e8a2ea-f29f-4822-acf9-447de053f5b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.243052 Jun 16 18:07:31.543814 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 86/172] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:31 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:31.630179 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-35ac2d14-8629-4cbf-89f1-f988ec61fb55 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:31.631732 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-35ac2d14-8629-4cbf-89f1-f988ec61fb55 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:31.638735 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-35ac2d14-8629-4cbf-89f1-f988ec61fb55 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:31.639289 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-35ac2d14-8629-4cbf-89f1-f988ec61fb55 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:31.640175 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-35ac2d14-8629-4cbf-89f1-f988ec61fb55 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:31.640675 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-35ac2d14-8629-4cbf-89f1-f988ec61fb55 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:31.857554 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-39db8169-e20a-4d28-88cc-fa90232dbf9f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:31.876903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-39db8169-e20a-4d28-88cc-fa90232dbf9f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.421601 Jun 16 18:07:31.882952 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 87/173] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:31 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:31.960748 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-35ac2d14-8629-4cbf-89f1-f988ec61fb55 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:31.969705 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-35ac2d14-8629-4cbf-89f1-f988ec61fb55 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.343350 Jun 16 18:07:31.970575 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 87/174] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:31 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:32.338205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5c3bf2e5-2e9a-49ad-a8b3-21c35a4f8c74 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:32.339450 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5c3bf2e5-2e9a-49ad-a8b3-21c35a4f8c74 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:32.346115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5c3bf2e5-2e9a-49ad-a8b3-21c35a4f8c74 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:32.346729 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5c3bf2e5-2e9a-49ad-a8b3-21c35a4f8c74 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:32.347673 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5c3bf2e5-2e9a-49ad-a8b3-21c35a4f8c74 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:32.348255 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5c3bf2e5-2e9a-49ad-a8b3-21c35a4f8c74 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:32.486714 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5c3bf2e5-2e9a-49ad-a8b3-21c35a4f8c74 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:32.494953 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5c3bf2e5-2e9a-49ad-a8b3-21c35a4f8c74 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.161283 Jun 16 18:07:32.495546 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 88/175] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:32 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:32.552304 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e973c777-458f-47ef-87ad-4869b40564b1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:32.553707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e973c777-458f-47ef-87ad-4869b40564b1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:32.565448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e973c777-458f-47ef-87ad-4869b40564b1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:32.566111 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e973c777-458f-47ef-87ad-4869b40564b1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:32.567452 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e973c777-458f-47ef-87ad-4869b40564b1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:32.568178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e973c777-458f-47ef-87ad-4869b40564b1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:32.726939 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e973c777-458f-47ef-87ad-4869b40564b1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:32.734943 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e973c777-458f-47ef-87ad-4869b40564b1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:32.736610 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e973c777-458f-47ef-87ad-4869b40564b1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:32.737707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e973c777-458f-47ef-87ad-4869b40564b1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.189740 Jun 16 18:07:32.738337 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 88/176] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:32 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:07:32.907826 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-13fb961c-bd8d-4203-a576-ed2b4a0b0566 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:32.909296 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-13fb961c-bd8d-4203-a576-ed2b4a0b0566 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:32.923134 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-13fb961c-bd8d-4203-a576-ed2b4a0b0566 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:32.923684 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-13fb961c-bd8d-4203-a576-ed2b4a0b0566 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:32.925221 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-13fb961c-bd8d-4203-a576-ed2b4a0b0566 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:32.925944 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-13fb961c-bd8d-4203-a576-ed2b4a0b0566 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:32.993491 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c3d6e49c-0e05-4f92-a104-7193d824fd2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:32.994576 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c3d6e49c-0e05-4f92-a104-7193d824fd2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:33.027619 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c3d6e49c-0e05-4f92-a104-7193d824fd2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:33.028767 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c3d6e49c-0e05-4f92-a104-7193d824fd2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:33.030279 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c3d6e49c-0e05-4f92-a104-7193d824fd2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:33.031252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c3d6e49c-0e05-4f92-a104-7193d824fd2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:33.268732 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-13fb961c-bd8d-4203-a576-ed2b4a0b0566 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:33.283220 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-13fb961c-bd8d-4203-a576-ed2b4a0b0566 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.379822 Jun 16 18:07:33.284595 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 89/177] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:32 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:33.317555 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c3d6e49c-0e05-4f92-a104-7193d824fd2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:33.325261 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c3d6e49c-0e05-4f92-a104-7193d824fd2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.341789 Jun 16 18:07:33.326171 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 89/178] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:32 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:33.513134 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-907fd252-39dd-4c1b-9127-c08078664b00 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:33.517109 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-907fd252-39dd-4c1b-9127-c08078664b00 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:33.531655 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-907fd252-39dd-4c1b-9127-c08078664b00 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:33.532111 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-907fd252-39dd-4c1b-9127-c08078664b00 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:33.532903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-907fd252-39dd-4c1b-9127-c08078664b00 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:33.533329 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-907fd252-39dd-4c1b-9127-c08078664b00 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:33.753338 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-907fd252-39dd-4c1b-9127-c08078664b00 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:33.756829 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-84f4ff25-3db3-4184-96ef-a2fa4736febf tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:33.757997 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-84f4ff25-3db3-4184-96ef-a2fa4736febf tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:33.762222 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-907fd252-39dd-4c1b-9127-c08078664b00 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.253210 Jun 16 18:07:33.763196 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 90/179] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:33 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:33.768911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-84f4ff25-3db3-4184-96ef-a2fa4736febf tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:33.769365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-84f4ff25-3db3-4184-96ef-a2fa4736febf tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:33.770147 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-84f4ff25-3db3-4184-96ef-a2fa4736febf tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:33.770573 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-84f4ff25-3db3-4184-96ef-a2fa4736febf tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:33.898813 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5bec3935-82aa-460f-b049-eddefd3f342a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fac6b14-f2b7-46ed-92d8-8ccb2b5b9d34"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:33.900030 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5bec3935-82aa-460f-b049-eddefd3f342a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:33.906214 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5bec3935-82aa-460f-b049-eddefd3f342a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:33.906654 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5bec3935-82aa-460f-b049-eddefd3f342a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:33.907437 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5bec3935-82aa-460f-b049-eddefd3f342a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:33.907869 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5bec3935-82aa-460f-b049-eddefd3f342a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:33.938809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-84f4ff25-3db3-4184-96ef-a2fa4736febf tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:33.953072 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-84f4ff25-3db3-4184-96ef-a2fa4736febf tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:33.955027 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-84f4ff25-3db3-4184-96ef-a2fa4736febf tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:33.956140 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-84f4ff25-3db3-4184-96ef-a2fa4736febf tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.203560 Jun 16 18:07:33.956762 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 90/180] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:33 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:34.302818 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8d46cbca-d5d8-4866-bea0-33d6a3f7a984 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:34.303986 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8d46cbca-d5d8-4866-bea0-33d6a3f7a984 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:34.317319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8d46cbca-d5d8-4866-bea0-33d6a3f7a984 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:34.317823 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8d46cbca-d5d8-4866-bea0-33d6a3f7a984 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:34.319157 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8d46cbca-d5d8-4866-bea0-33d6a3f7a984 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:34.320503 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8d46cbca-d5d8-4866-bea0-33d6a3f7a984 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:34.746549 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8d46cbca-d5d8-4866-bea0-33d6a3f7a984 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:34.756041 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8d46cbca-d5d8-4866-bea0-33d6a3f7a984 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.456436 Jun 16 18:07:34.756041 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 91/181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:34 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:34.761380 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9a2e4f6d-0f4f-4940-bc63-bc5df19b3c76 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:34.762004 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9a2e4f6d-0f4f-4940-bc63-bc5df19b3c76 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:34.768421 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9a2e4f6d-0f4f-4940-bc63-bc5df19b3c76 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:34.769381 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9a2e4f6d-0f4f-4940-bc63-bc5df19b3c76 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:34.770185 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9a2e4f6d-0f4f-4940-bc63-bc5df19b3c76 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:34.770620 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9a2e4f6d-0f4f-4940-bc63-bc5df19b3c76 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:34.989407 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9a2e4f6d-0f4f-4940-bc63-bc5df19b3c76 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:35.012699 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9a2e4f6d-0f4f-4940-bc63-bc5df19b3c76 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.251270 Jun 16 18:07:35.012699 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 92/182] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:34 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:35.014276 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2d8a78a1-fb89-4d7b-8282-bf22960f9cd1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:35.014898 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2d8a78a1-fb89-4d7b-8282-bf22960f9cd1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:35.022894 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2d8a78a1-fb89-4d7b-8282-bf22960f9cd1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:35.023352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2d8a78a1-fb89-4d7b-8282-bf22960f9cd1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:35.024232 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2d8a78a1-fb89-4d7b-8282-bf22960f9cd1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:35.024670 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2d8a78a1-fb89-4d7b-8282-bf22960f9cd1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:35.194869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2d8a78a1-fb89-4d7b-8282-bf22960f9cd1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:35.202942 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2d8a78a1-fb89-4d7b-8282-bf22960f9cd1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.192502 Jun 16 18:07:35.203654 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 93/183] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:35 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:35.208465 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b76286c3-432d-4625-9f2b-e54cf928f6e9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:35.209303 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b76286c3-432d-4625-9f2b-e54cf928f6e9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:35.216496 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b76286c3-432d-4625-9f2b-e54cf928f6e9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:35.217049 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b76286c3-432d-4625-9f2b-e54cf928f6e9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:35.217970 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b76286c3-432d-4625-9f2b-e54cf928f6e9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:35.218506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b76286c3-432d-4625-9f2b-e54cf928f6e9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:35.274633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5bec3935-82aa-460f-b049-eddefd3f342a tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "POST /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.380700 Jun 16 18:07:35.283103 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 91/184] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:07:33 2022] POST /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f/os-volume_attachments => generated 194 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:07:35.418736 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b76286c3-432d-4625-9f2b-e54cf928f6e9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:35.429220 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b76286c3-432d-4625-9f2b-e54cf928f6e9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:35.430929 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b76286c3-432d-4625-9f2b-e54cf928f6e9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:35.432196 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b76286c3-432d-4625-9f2b-e54cf928f6e9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.227398 Jun 16 18:07:35.432755 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 94/185] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:35 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:35.774522 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3fdfc936-cd3c-4ad4-bd90-1d373e616eb5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:35.775182 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3fdfc936-cd3c-4ad4-bd90-1d373e616eb5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:35.782292 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3fdfc936-cd3c-4ad4-bd90-1d373e616eb5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:35.783021 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3fdfc936-cd3c-4ad4-bd90-1d373e616eb5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:35.784267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3fdfc936-cd3c-4ad4-bd90-1d373e616eb5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:35.784790 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3fdfc936-cd3c-4ad4-bd90-1d373e616eb5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:35.961869 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3fdfc936-cd3c-4ad4-bd90-1d373e616eb5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:35.978498 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3fdfc936-cd3c-4ad4-bd90-1d373e616eb5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.204520 Jun 16 18:07:35.978498 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 92/186] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:35 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:36.026595 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-feb0a171-1de9-45c2-a788-d9fa7f29a324 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:36.027873 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-feb0a171-1de9-45c2-a788-d9fa7f29a324 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:36.034219 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-feb0a171-1de9-45c2-a788-d9fa7f29a324 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:36.034602 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-feb0a171-1de9-45c2-a788-d9fa7f29a324 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:36.035415 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-feb0a171-1de9-45c2-a788-d9fa7f29a324 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:36.035839 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-feb0a171-1de9-45c2-a788-d9fa7f29a324 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:36.224372 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-42ad53a0-9025-4822-aa26-6902bab2bbbd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:36.226479 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-42ad53a0-9025-4822-aa26-6902bab2bbbd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:36.228653 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-feb0a171-1de9-45c2-a788-d9fa7f29a324 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:36.247849 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-42ad53a0-9025-4822-aa26-6902bab2bbbd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:36.248640 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-42ad53a0-9025-4822-aa26-6902bab2bbbd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:36.254591 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-feb0a171-1de9-45c2-a788-d9fa7f29a324 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.231594 Jun 16 18:07:36.256623 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 95/187] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:36 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:36.262147 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-42ad53a0-9025-4822-aa26-6902bab2bbbd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:36.264434 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-42ad53a0-9025-4822-aa26-6902bab2bbbd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:36.404908 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-7fa8cfc8-0f5c-4bc6-9814-9b6832d9c886 req-0f1e4e02-9459-4647-b3dd-d7d48e66437e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77efc8cd-421f-42e8-98e5-cb9e269e9e6e", "name": "network-vif-plugged", "status": "completed", "tag": "8557bd0c-ae73-4af6-b470-984e296cdd16"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:36.418720 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-7fa8cfc8-0f5c-4bc6-9814-9b6832d9c886 req-0f1e4e02-9459-4647-b3dd-d7d48e66437e service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:36.421279 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-7fa8cfc8-0f5c-4bc6-9814-9b6832d9c886 req-0f1e4e02-9459-4647-b3dd-d7d48e66437e service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:36.442374 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-7fa8cfc8-0f5c-4bc6-9814-9b6832d9c886 req-0f1e4e02-9459-4647-b3dd-d7d48e66437e service nova] Creating event network-vif-plugged:8557bd0c-ae73-4af6-b470-984e296cdd16 for instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e on hv-cinder-83754 Jun 16 18:07:36.464501 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-7fa8cfc8-0f5c-4bc6-9814-9b6832d9c886 req-0f1e4e02-9459-4647-b3dd-d7d48e66437e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066267 Jun 16 18:07:36.465558 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 96/188] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:07:36.489414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-157f8559-074f-4e14-9ea6-cfea1b1e40ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:36.490224 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-157f8559-074f-4e14-9ea6-cfea1b1e40ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:36.497640 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-42ad53a0-9025-4822-aa26-6902bab2bbbd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:36.500648 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-157f8559-074f-4e14-9ea6-cfea1b1e40ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:36.501100 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-157f8559-074f-4e14-9ea6-cfea1b1e40ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:36.502065 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-157f8559-074f-4e14-9ea6-cfea1b1e40ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:36.502503 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-157f8559-074f-4e14-9ea6-cfea1b1e40ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:36.509584 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=100 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:36.513751 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-42ad53a0-9025-4822-aa26-6902bab2bbbd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.296204 Jun 16 18:07:36.519780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 93/189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:36 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:36.664973 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-157f8559-074f-4e14-9ea6-cfea1b1e40ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:36.674787 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-157f8559-074f-4e14-9ea6-cfea1b1e40ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:36.676330 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-157f8559-074f-4e14-9ea6-cfea1b1e40ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:36.677448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-157f8559-074f-4e14-9ea6-cfea1b1e40ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.210656 Jun 16 18:07:36.685700 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 97/190] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:36 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:36.993872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d65c8ad9-8b8e-4537-96b5-c16ce7540b18 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:36.994488 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d65c8ad9-8b8e-4537-96b5-c16ce7540b18 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:37.001872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d65c8ad9-8b8e-4537-96b5-c16ce7540b18 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:37.002697 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d65c8ad9-8b8e-4537-96b5-c16ce7540b18 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:37.003831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d65c8ad9-8b8e-4537-96b5-c16ce7540b18 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:37.004301 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d65c8ad9-8b8e-4537-96b5-c16ce7540b18 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:37.142178 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d65c8ad9-8b8e-4537-96b5-c16ce7540b18 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:37.150743 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d65c8ad9-8b8e-4537-96b5-c16ce7540b18 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.160694 Jun 16 18:07:37.151333 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 94/191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:36 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:37.273945 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6d8dd94e-def8-4e2a-89e1-5d19da690cf5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:37.274555 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6d8dd94e-def8-4e2a-89e1-5d19da690cf5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:37.281262 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6d8dd94e-def8-4e2a-89e1-5d19da690cf5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:37.281702 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6d8dd94e-def8-4e2a-89e1-5d19da690cf5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:37.282450 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6d8dd94e-def8-4e2a-89e1-5d19da690cf5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:37.282920 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6d8dd94e-def8-4e2a-89e1-5d19da690cf5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:37.415810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6d8dd94e-def8-4e2a-89e1-5d19da690cf5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:37.423481 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6d8dd94e-def8-4e2a-89e1-5d19da690cf5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.154362 Jun 16 18:07:37.433143 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 98/192] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:37 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:37.535896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0d6d82e3-9c4a-4a34-b156-0d30abc41563 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:37.537218 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0d6d82e3-9c4a-4a34-b156-0d30abc41563 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:37.544541 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0d6d82e3-9c4a-4a34-b156-0d30abc41563 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:37.545068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0d6d82e3-9c4a-4a34-b156-0d30abc41563 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:37.545948 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0d6d82e3-9c4a-4a34-b156-0d30abc41563 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:37.546618 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0d6d82e3-9c4a-4a34-b156-0d30abc41563 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:37.696987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-790bae3f-373d-41b5-98ea-0e9fa1580208 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:37.697626 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-790bae3f-373d-41b5-98ea-0e9fa1580208 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:37.704219 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-790bae3f-373d-41b5-98ea-0e9fa1580208 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:37.704670 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-790bae3f-373d-41b5-98ea-0e9fa1580208 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:37.705429 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-790bae3f-373d-41b5-98ea-0e9fa1580208 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:37.705861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-790bae3f-373d-41b5-98ea-0e9fa1580208 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:37.895405 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0d6d82e3-9c4a-4a34-b156-0d30abc41563 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:37.902862 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-790bae3f-373d-41b5-98ea-0e9fa1580208 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:37.904224 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0d6d82e3-9c4a-4a34-b156-0d30abc41563 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.371748 Jun 16 18:07:37.906831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 95/193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:37 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:37.914446 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-790bae3f-373d-41b5-98ea-0e9fa1580208 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:37.916091 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-790bae3f-373d-41b5-98ea-0e9fa1580208 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:37.917250 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-790bae3f-373d-41b5-98ea-0e9fa1580208 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.224918 Jun 16 18:07:37.917807 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 99/194] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:37 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:07:38.168647 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-603fd6d3-6df2-4f3d-97bf-cec2fe69cb62 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:38.169259 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-603fd6d3-6df2-4f3d-97bf-cec2fe69cb62 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:38.175986 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-603fd6d3-6df2-4f3d-97bf-cec2fe69cb62 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:38.176439 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-603fd6d3-6df2-4f3d-97bf-cec2fe69cb62 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:38.177209 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-603fd6d3-6df2-4f3d-97bf-cec2fe69cb62 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:38.177639 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-603fd6d3-6df2-4f3d-97bf-cec2fe69cb62 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:38.308067 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-603fd6d3-6df2-4f3d-97bf-cec2fe69cb62 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:38.315773 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-603fd6d3-6df2-4f3d-97bf-cec2fe69cb62 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.151076 Jun 16 18:07:38.316327 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 96/195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:38 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:38.441067 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2c32bd78-98c3-4de6-8f01-72999258b25c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:38.441599 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2c32bd78-98c3-4de6-8f01-72999258b25c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:38.447839 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2c32bd78-98c3-4de6-8f01-72999258b25c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:38.449271 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2c32bd78-98c3-4de6-8f01-72999258b25c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:38.449271 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2c32bd78-98c3-4de6-8f01-72999258b25c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:38.449521 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2c32bd78-98c3-4de6-8f01-72999258b25c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:38.596391 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2c32bd78-98c3-4de6-8f01-72999258b25c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:38.605380 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2c32bd78-98c3-4de6-8f01-72999258b25c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.168797 Jun 16 18:07:38.606136 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 100/196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:38 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:38.921505 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ab9c324b-8cd6-401d-b035-272936708bfd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:38.922120 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ab9c324b-8cd6-401d-b035-272936708bfd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:38.928247 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab9c324b-8cd6-401d-b035-272936708bfd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:38.928705 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab9c324b-8cd6-401d-b035-272936708bfd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:38.929543 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab9c324b-8cd6-401d-b035-272936708bfd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:38.929988 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab9c324b-8cd6-401d-b035-272936708bfd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:38.936187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9e952cfb-b371-46f8-8c28-d6f28c413ef9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:38.936804 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9e952cfb-b371-46f8-8c28-d6f28c413ef9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:38.944043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9e952cfb-b371-46f8-8c28-d6f28c413ef9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:38.944639 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9e952cfb-b371-46f8-8c28-d6f28c413ef9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:38.945702 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9e952cfb-b371-46f8-8c28-d6f28c413ef9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:38.946140 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9e952cfb-b371-46f8-8c28-d6f28c413ef9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:39.146142 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ab9c324b-8cd6-401d-b035-272936708bfd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:39.153612 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9e952cfb-b371-46f8-8c28-d6f28c413ef9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:39.153914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ab9c324b-8cd6-401d-b035-272936708bfd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.236184 Jun 16 18:07:39.154558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 97/197] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:38 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:39.161992 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9e952cfb-b371-46f8-8c28-d6f28c413ef9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:39.163515 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9e952cfb-b371-46f8-8c28-d6f28c413ef9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:39.164659 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9e952cfb-b371-46f8-8c28-d6f28c413ef9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.232701 Jun 16 18:07:39.165340 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 101/198] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:38 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:39.332997 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b2cbff88-c88d-4ace-9fff-99df4150c24d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:39.333654 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b2cbff88-c88d-4ace-9fff-99df4150c24d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:39.340272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b2cbff88-c88d-4ace-9fff-99df4150c24d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:39.340720 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b2cbff88-c88d-4ace-9fff-99df4150c24d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:39.341493 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b2cbff88-c88d-4ace-9fff-99df4150c24d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:39.341927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b2cbff88-c88d-4ace-9fff-99df4150c24d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:39.474035 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b2cbff88-c88d-4ace-9fff-99df4150c24d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:39.482748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b2cbff88-c88d-4ace-9fff-99df4150c24d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.153547 Jun 16 18:07:39.483324 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 98/199] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:39 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:39.623696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7cb8a4a1-edce-428c-8d93-00e1a2e05053 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:39.624329 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7cb8a4a1-edce-428c-8d93-00e1a2e05053 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:39.630431 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7cb8a4a1-edce-428c-8d93-00e1a2e05053 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:39.630876 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7cb8a4a1-edce-428c-8d93-00e1a2e05053 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:39.631685 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7cb8a4a1-edce-428c-8d93-00e1a2e05053 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:39.632112 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7cb8a4a1-edce-428c-8d93-00e1a2e05053 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:39.778269 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7cb8a4a1-edce-428c-8d93-00e1a2e05053 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:39.785989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7cb8a4a1-edce-428c-8d93-00e1a2e05053 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.166443 Jun 16 18:07:39.786551 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 102/200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:39 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:40.172423 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5f721ffb-a2d0-4f04-bd9c-7069fb13d475 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:40.173130 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5f721ffb-a2d0-4f04-bd9c-7069fb13d475 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:40.179339 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5f721ffb-a2d0-4f04-bd9c-7069fb13d475 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:40.179913 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5f721ffb-a2d0-4f04-bd9c-7069fb13d475 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:40.180683 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5f721ffb-a2d0-4f04-bd9c-7069fb13d475 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:40.181111 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5f721ffb-a2d0-4f04-bd9c-7069fb13d475 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:40.182229 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a4c5e33a-a206-4ce9-bf44-ca34789f028a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:40.182756 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a4c5e33a-a206-4ce9-bf44-ca34789f028a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:40.188985 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a4c5e33a-a206-4ce9-bf44-ca34789f028a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:40.189432 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a4c5e33a-a206-4ce9-bf44-ca34789f028a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:40.190375 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a4c5e33a-a206-4ce9-bf44-ca34789f028a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:40.190670 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a4c5e33a-a206-4ce9-bf44-ca34789f028a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:40.384394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5f721ffb-a2d0-4f04-bd9c-7069fb13d475 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:40.389884 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a4c5e33a-a206-4ce9-bf44-ca34789f028a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:40.392521 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5f721ffb-a2d0-4f04-bd9c-7069fb13d475 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.224185 Jun 16 18:07:40.393108 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 99/201] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:40 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:40.400515 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a4c5e33a-a206-4ce9-bf44-ca34789f028a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:40.402599 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a4c5e33a-a206-4ce9-bf44-ca34789f028a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:40.403807 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a4c5e33a-a206-4ce9-bf44-ca34789f028a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.225668 Jun 16 18:07:40.404361 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 103/202] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:40 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:07:40.500311 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-27506523-9c8d-40ae-96c8-f8640feab947 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:40.500827 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-27506523-9c8d-40ae-96c8-f8640feab947 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:40.507023 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-27506523-9c8d-40ae-96c8-f8640feab947 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:40.507509 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-27506523-9c8d-40ae-96c8-f8640feab947 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:40.508825 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-27506523-9c8d-40ae-96c8-f8640feab947 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:40.509256 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-27506523-9c8d-40ae-96c8-f8640feab947 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:40.645988 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-27506523-9c8d-40ae-96c8-f8640feab947 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:40.653940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-27506523-9c8d-40ae-96c8-f8640feab947 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.157836 Jun 16 18:07:40.654528 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 100/203] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:40 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:40.803217 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-98d506b5-cb1d-4a07-a687-9331b4be5dcc tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:40.803852 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-98d506b5-cb1d-4a07-a687-9331b4be5dcc tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:40.811135 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-98d506b5-cb1d-4a07-a687-9331b4be5dcc tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:40.811614 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-98d506b5-cb1d-4a07-a687-9331b4be5dcc tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:40.812368 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-98d506b5-cb1d-4a07-a687-9331b4be5dcc tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:40.812799 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-98d506b5-cb1d-4a07-a687-9331b4be5dcc tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:40.942528 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-98d506b5-cb1d-4a07-a687-9331b4be5dcc tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:40.950004 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-98d506b5-cb1d-4a07-a687-9331b4be5dcc tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.150810 Jun 16 18:07:40.950559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 104/204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:40 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:41.412034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0d62487f-53e1-4f26-8ad5-f7c069d0f66e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:41.412895 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0d62487f-53e1-4f26-8ad5-f7c069d0f66e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:41.422953 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f964a488-eead-468f-a10b-4aa4caa3dce4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:41.423979 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f964a488-eead-468f-a10b-4aa4caa3dce4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:41.424895 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0d62487f-53e1-4f26-8ad5-f7c069d0f66e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:41.425357 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0d62487f-53e1-4f26-8ad5-f7c069d0f66e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:41.426133 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0d62487f-53e1-4f26-8ad5-f7c069d0f66e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:41.426744 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0d62487f-53e1-4f26-8ad5-f7c069d0f66e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:41.431727 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f964a488-eead-468f-a10b-4aa4caa3dce4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:41.432197 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f964a488-eead-468f-a10b-4aa4caa3dce4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:41.432969 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f964a488-eead-468f-a10b-4aa4caa3dce4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:41.433432 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f964a488-eead-468f-a10b-4aa4caa3dce4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:41.450334 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:41.639622 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0d62487f-53e1-4f26-8ad5-f7c069d0f66e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:41.646617 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f964a488-eead-468f-a10b-4aa4caa3dce4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:41.647075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0d62487f-53e1-4f26-8ad5-f7c069d0f66e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.238901 Jun 16 18:07:41.647683 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 101/205] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:41 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:41.655461 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f964a488-eead-468f-a10b-4aa4caa3dce4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:41.657057 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f964a488-eead-468f-a10b-4aa4caa3dce4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:41.658152 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f964a488-eead-468f-a10b-4aa4caa3dce4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.239324 Jun 16 18:07:41.658715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 105/206] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:41 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:41.671804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-7ede12b3-1596-4b35-b064-8444fdc3742c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:41.672433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-7ede12b3-1596-4b35-b064-8444fdc3742c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:41.678844 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7ede12b3-1596-4b35-b064-8444fdc3742c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:41.678844 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7ede12b3-1596-4b35-b064-8444fdc3742c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:41.679660 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7ede12b3-1596-4b35-b064-8444fdc3742c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:41.680812 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7ede12b3-1596-4b35-b064-8444fdc3742c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:41.905479 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7ede12b3-1596-4b35-b064-8444fdc3742c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:41.913069 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-7ede12b3-1596-4b35-b064-8444fdc3742c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.244994 Jun 16 18:07:41.913703 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 102/207] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:41 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:41.967343 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-fb08e0db-8e63-48c7-9e54-a58a28149493 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:41.967947 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-fb08e0db-8e63-48c7-9e54-a58a28149493 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:41.973881 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fb08e0db-8e63-48c7-9e54-a58a28149493 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:41.974321 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fb08e0db-8e63-48c7-9e54-a58a28149493 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:41.975061 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fb08e0db-8e63-48c7-9e54-a58a28149493 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:41.975516 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fb08e0db-8e63-48c7-9e54-a58a28149493 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:42.103113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-fb08e0db-8e63-48c7-9e54-a58a28149493 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:42.110671 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-fb08e0db-8e63-48c7-9e54-a58a28149493 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.147112 Jun 16 18:07:42.111236 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 106/208] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:41 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:42.607051 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-c53198fb-6c21-45a1-9264-c217cdd11ebc req-b87db656-2518-4c62-a4c5-a476d5b18e1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1134706f-4520-434d-877f-bc6465b3e282", "name": "network-vif-plugged", "status": "completed", "tag": "41a992ba-4fda-42d8-a121-3c7c2f9e6d3d"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:42.615506 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-c53198fb-6c21-45a1-9264-c217cdd11ebc req-b87db656-2518-4c62-a4c5-a476d5b18e1c service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:42.615947 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-c53198fb-6c21-45a1-9264-c217cdd11ebc req-b87db656-2518-4c62-a4c5-a476d5b18e1c service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:42.627749 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-c53198fb-6c21-45a1-9264-c217cdd11ebc req-b87db656-2518-4c62-a4c5-a476d5b18e1c service nova] Creating event network-vif-plugged:41a992ba-4fda-42d8-a121-3c7c2f9e6d3d for instance 1134706f-4520-434d-877f-bc6465b3e282 on hv-cinder-83754 Jun 16 18:07:42.632645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-c53198fb-6c21-45a1-9264-c217cdd11ebc req-b87db656-2518-4c62-a4c5-a476d5b18e1c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029340 Jun 16 18:07:42.633223 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 103/209] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:42.664531 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b9f41d12-63d8-423c-8039-81070a6e65a9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:42.665144 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b9f41d12-63d8-423c-8039-81070a6e65a9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:42.671830 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b9f41d12-63d8-423c-8039-81070a6e65a9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:42.672287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b9f41d12-63d8-423c-8039-81070a6e65a9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:42.673055 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b9f41d12-63d8-423c-8039-81070a6e65a9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:42.673488 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b9f41d12-63d8-423c-8039-81070a6e65a9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:42.677026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-24442a21-19be-412b-93dc-13aee16c0545 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:42.677732 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-24442a21-19be-412b-93dc-13aee16c0545 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:42.684180 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24442a21-19be-412b-93dc-13aee16c0545 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:42.684628 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24442a21-19be-412b-93dc-13aee16c0545 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:42.685431 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24442a21-19be-412b-93dc-13aee16c0545 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:42.685829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24442a21-19be-412b-93dc-13aee16c0545 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:42.878791 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b9f41d12-63d8-423c-8039-81070a6e65a9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:42.887563 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b9f41d12-63d8-423c-8039-81070a6e65a9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.226722 Jun 16 18:07:42.888365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 107/210] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:42 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:42.895698 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-24442a21-19be-412b-93dc-13aee16c0545 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:42.902200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1084563102", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "networks": [{"uuid": "2134625a-e5ca-440f-9971-f03f07198b47"}]}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:42.909555 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-24442a21-19be-412b-93dc-13aee16c0545 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:42.911353 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-24442a21-19be-412b-93dc-13aee16c0545 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:42.912600 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-24442a21-19be-412b-93dc-13aee16c0545 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.239807 Jun 16 18:07:42.913265 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 104/211] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:42 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:07:42.930018 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ed9ff408-f1fb-45cb-98cd-946d08ddc9af tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:42.930710 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ed9ff408-f1fb-45cb-98cd-946d08ddc9af tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:42.937533 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ed9ff408-f1fb-45cb-98cd-946d08ddc9af tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:42.937974 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ed9ff408-f1fb-45cb-98cd-946d08ddc9af tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:42.938739 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ed9ff408-f1fb-45cb-98cd-946d08ddc9af tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:42.940400 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ed9ff408-f1fb-45cb-98cd-946d08ddc9af tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:42.967965 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] validate_networks() for [('2134625a-e5ca-440f-9971-f03f07198b47', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:07:43.168276 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ed9ff408-f1fb-45cb-98cd-946d08ddc9af tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:43.176456 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ed9ff408-f1fb-45cb-98cd-946d08ddc9af tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.250311 Jun 16 18:07:43.177131 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 105/212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:42 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:43.182304 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6839b79b-4891-4737-8914-6b31adfa5dbe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:43.183327 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6839b79b-4891-4737-8914-6b31adfa5dbe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:43.189413 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6839b79b-4891-4737-8914-6b31adfa5dbe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:43.189861 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6839b79b-4891-4737-8914-6b31adfa5dbe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:43.190654 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6839b79b-4891-4737-8914-6b31adfa5dbe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:43.191090 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6839b79b-4891-4737-8914-6b31adfa5dbe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:43.411456 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6839b79b-4891-4737-8914-6b31adfa5dbe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:43.419762 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6839b79b-4891-4737-8914-6b31adfa5dbe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.241605 Jun 16 18:07:43.420332 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 106/213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:43 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:43.471337 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:07:43.471783 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:07:43.472275 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:07:43.472679 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:07:43.473086 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:07:43.482919 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:43.483382 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:43.484244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:43.484678 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:43.502406 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Getting quotas for project 7385d827292c44cf91ca0689dfc3753a. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:07:43.506429 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Getting quotas for user 84114b0e2d6d4ea4b0b494d8b6e66a0e and project 7385d827292c44cf91ca0689dfc3753a. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:07:43.515579 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=100 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:43.518042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:07:43.520320 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:07:43.737140 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2db19fa3-a19f-4e6f-bb98-1d28ef0faa59 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838765 Jun 16 18:07:43.737780 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 108/214] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:07:43.748652 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-7c35de01-1f4d-4d0c-be36-20a8b2b5b488 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:43.749268 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-7c35de01-1f4d-4d0c-be36-20a8b2b5b488 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:43.803975 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7c35de01-1f4d-4d0c-be36-20a8b2b5b488 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:43.812491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-7c35de01-1f4d-4d0c-be36-20a8b2b5b488 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1214 microversion: 2.1 time: 0.068469 Jun 16 18:07:43.813128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 107/215] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:43 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:43.905199 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3757dbc0-01a1-4440-87b2-b61965bcbd8e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:43.905824 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3757dbc0-01a1-4440-87b2-b61965bcbd8e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:43.912108 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3757dbc0-01a1-4440-87b2-b61965bcbd8e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:43.912700 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3757dbc0-01a1-4440-87b2-b61965bcbd8e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:43.913472 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3757dbc0-01a1-4440-87b2-b61965bcbd8e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:43.913904 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3757dbc0-01a1-4440-87b2-b61965bcbd8e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:43.933557 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1ea8ca20-72a4-4846-8ea9-513c4f715ca0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:43.934162 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1ea8ca20-72a4-4846-8ea9-513c4f715ca0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:43.950934 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1ea8ca20-72a4-4846-8ea9-513c4f715ca0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:43.950934 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1ea8ca20-72a4-4846-8ea9-513c4f715ca0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:43.950934 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1ea8ca20-72a4-4846-8ea9-513c4f715ca0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:43.950934 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1ea8ca20-72a4-4846-8ea9-513c4f715ca0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:44.137192 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3757dbc0-01a1-4440-87b2-b61965bcbd8e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:44.144951 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3757dbc0-01a1-4440-87b2-b61965bcbd8e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1367 microversion: 2.1 time: 0.243841 Jun 16 18:07:44.145529 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 109/216] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:43 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:44.159035 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1ea8ca20-72a4-4846-8ea9-513c4f715ca0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:44.168597 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1ea8ca20-72a4-4846-8ea9-513c4f715ca0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:44.170148 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1ea8ca20-72a4-4846-8ea9-513c4f715ca0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:44.171291 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1ea8ca20-72a4-4846-8ea9-513c4f715ca0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.242216 Jun 16 18:07:44.171918 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 108/217] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:43 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:44.205577 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ae8a058c-db30-4d1d-9a67-fc81631ea859 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:44.205789 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ae8a058c-db30-4d1d-9a67-fc81631ea859 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:44.214855 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ae8a058c-db30-4d1d-9a67-fc81631ea859 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:44.215358 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ae8a058c-db30-4d1d-9a67-fc81631ea859 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:44.216322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ae8a058c-db30-4d1d-9a67-fc81631ea859 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:44.216758 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ae8a058c-db30-4d1d-9a67-fc81631ea859 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:44.435686 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d9a079eb-a8e9-429e-90cc-154aab1e4fc7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:44.436294 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d9a079eb-a8e9-429e-90cc-154aab1e4fc7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:44.452219 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d9a079eb-a8e9-429e-90cc-154aab1e4fc7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:44.452929 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d9a079eb-a8e9-429e-90cc-154aab1e4fc7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:44.454076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d9a079eb-a8e9-429e-90cc-154aab1e4fc7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:44.454863 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d9a079eb-a8e9-429e-90cc-154aab1e4fc7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:44.719796 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ae8a058c-db30-4d1d-9a67-fc81631ea859 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:44.728311 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ae8a058c-db30-4d1d-9a67-fc81631ea859 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.526988 Jun 16 18:07:44.730399 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 110/218] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:44 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:44.834659 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-23702219-add9-46d3-a094-ff9fbfe11ecc tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:44.842538 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d9a079eb-a8e9-429e-90cc-154aab1e4fc7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:44.850250 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-23702219-add9-46d3-a094-ff9fbfe11ecc tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:44.858086 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d9a079eb-a8e9-429e-90cc-154aab1e4fc7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.425884 Jun 16 18:07:44.867821 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 109/219] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:44 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:44.930579 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-23702219-add9-46d3-a094-ff9fbfe11ecc tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:44.938221 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-23702219-add9-46d3-a094-ff9fbfe11ecc tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1214 microversion: 2.1 time: 0.109517 Jun 16 18:07:44.938936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 111/220] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:44 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:45.163428 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ba6e6753-e2a1-49f9-9f9c-65ee6bc8ac16 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:45.164035 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ba6e6753-e2a1-49f9-9f9c-65ee6bc8ac16 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:45.171040 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ba6e6753-e2a1-49f9-9f9c-65ee6bc8ac16 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:45.171633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ba6e6753-e2a1-49f9-9f9c-65ee6bc8ac16 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:45.173708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ba6e6753-e2a1-49f9-9f9c-65ee6bc8ac16 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:45.173708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ba6e6753-e2a1-49f9-9f9c-65ee6bc8ac16 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:45.193194 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3571c2e0-7874-4710-9f3e-f2f1f341bbc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:45.193744 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3571c2e0-7874-4710-9f3e-f2f1f341bbc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:45.207657 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3571c2e0-7874-4710-9f3e-f2f1f341bbc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:45.208516 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3571c2e0-7874-4710-9f3e-f2f1f341bbc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:45.209516 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3571c2e0-7874-4710-9f3e-f2f1f341bbc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:45.210183 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3571c2e0-7874-4710-9f3e-f2f1f341bbc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:45.388175 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ba6e6753-e2a1-49f9-9f9c-65ee6bc8ac16 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:45.395957 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ba6e6753-e2a1-49f9-9f9c-65ee6bc8ac16 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1557 microversion: 2.1 time: 0.236488 Jun 16 18:07:45.396524 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 110/221] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:45 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1557 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:45.412625 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3571c2e0-7874-4710-9f3e-f2f1f341bbc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:45.423493 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0b778435-d4e7-4a10-80e1-e65827e729dc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:45.423493 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0b778435-d4e7-4a10-80e1-e65827e729dc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:45.423708 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3571c2e0-7874-4710-9f3e-f2f1f341bbc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:45.423708 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3571c2e0-7874-4710-9f3e-f2f1f341bbc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:45.423921 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0b778435-d4e7-4a10-80e1-e65827e729dc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:45.423921 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0b778435-d4e7-4a10-80e1-e65827e729dc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:45.424419 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3571c2e0-7874-4710-9f3e-f2f1f341bbc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.238010 Jun 16 18:07:45.424520 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0b778435-d4e7-4a10-80e1-e65827e729dc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:45.424623 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0b778435-d4e7-4a10-80e1-e65827e729dc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:45.427758 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 112/222] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:45 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:45.513874 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0b778435-d4e7-4a10-80e1-e65827e729dc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100726 Jun 16 18:07:45.513874 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 111/223] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jun 16 18:07:45 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:07:45.747153 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-cc34fe95-6e08-47ca-8640-425a7ba63c1e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:45.747782 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-cc34fe95-6e08-47ca-8640-425a7ba63c1e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:45.754235 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cc34fe95-6e08-47ca-8640-425a7ba63c1e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:45.754682 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cc34fe95-6e08-47ca-8640-425a7ba63c1e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:45.755465 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cc34fe95-6e08-47ca-8640-425a7ba63c1e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:45.755908 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cc34fe95-6e08-47ca-8640-425a7ba63c1e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:45.877885 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0b56893b-742a-41b3-8978-0307f57fafcd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:45.879551 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0b56893b-742a-41b3-8978-0307f57fafcd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:45.886865 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0b56893b-742a-41b3-8978-0307f57fafcd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:45.894220 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0b56893b-742a-41b3-8978-0307f57fafcd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:45.894220 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0b56893b-742a-41b3-8978-0307f57fafcd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:45.894220 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0b56893b-742a-41b3-8978-0307f57fafcd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:45.898505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-cc34fe95-6e08-47ca-8640-425a7ba63c1e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:45.915581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-cc34fe95-6e08-47ca-8640-425a7ba63c1e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.173043 Jun 16 18:07:45.918805 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 113/224] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:45 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:45.956372 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5c0a3ac0-4030-4372-843e-566eb6e7b82d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:45.957205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5c0a3ac0-4030-4372-843e-566eb6e7b82d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:45.965488 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5c0a3ac0-4030-4372-843e-566eb6e7b82d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:45.965488 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5c0a3ac0-4030-4372-843e-566eb6e7b82d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:45.966035 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5c0a3ac0-4030-4372-843e-566eb6e7b82d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:45.966472 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5c0a3ac0-4030-4372-843e-566eb6e7b82d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:46.051088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5c0a3ac0-4030-4372-843e-566eb6e7b82d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:46.060692 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5c0a3ac0-4030-4372-843e-566eb6e7b82d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1218 microversion: 2.1 time: 0.108844 Jun 16 18:07:46.062029 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 114/225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:45 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:46.067933 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0b56893b-742a-41b3-8978-0307f57fafcd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:46.077398 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0b56893b-742a-41b3-8978-0307f57fafcd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.206223 Jun 16 18:07:46.084694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 112/226] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:45 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:46.441788 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f730bd3f-0e70-41b0-8492-0c589e15f4f3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:46.442399 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f730bd3f-0e70-41b0-8492-0c589e15f4f3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:46.448512 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f730bd3f-0e70-41b0-8492-0c589e15f4f3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:46.448961 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f730bd3f-0e70-41b0-8492-0c589e15f4f3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:46.450005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f730bd3f-0e70-41b0-8492-0c589e15f4f3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:46.450505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f730bd3f-0e70-41b0-8492-0c589e15f4f3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:46.469284 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=100 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:46.599783 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f730bd3f-0e70-41b0-8492-0c589e15f4f3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:46.609849 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f730bd3f-0e70-41b0-8492-0c589e15f4f3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:46.611476 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f730bd3f-0e70-41b0-8492-0c589e15f4f3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:46.612593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f730bd3f-0e70-41b0-8492-0c589e15f4f3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.174727 Jun 16 18:07:46.613440 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 115/227] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:46 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:46.935129 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-49215d01-173b-42b6-bfcb-af60b94305f4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:46.935790 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-49215d01-173b-42b6-bfcb-af60b94305f4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:46.942676 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-49215d01-173b-42b6-bfcb-af60b94305f4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:46.943242 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-49215d01-173b-42b6-bfcb-af60b94305f4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:46.944047 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-49215d01-173b-42b6-bfcb-af60b94305f4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:46.944484 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-49215d01-173b-42b6-bfcb-af60b94305f4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:47.077495 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-ae5e536b-3bfe-427d-bb14-eeec711c2edf req-cef88452-9bc9-496e-88d3-0fd9fd87d6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77efc8cd-421f-42e8-98e5-cb9e269e9e6e", "tag": "8557bd0c-ae73-4af6-b470-984e296cdd16"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:47.098520 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-ae5e536b-3bfe-427d-bb14-eeec711c2edf req-cef88452-9bc9-496e-88d3-0fd9fd87d6f3 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:47.101755 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-ae5e536b-3bfe-427d-bb14-eeec711c2edf req-cef88452-9bc9-496e-88d3-0fd9fd87d6f3 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:47.119095 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-ae5e536b-3bfe-427d-bb14-eeec711c2edf req-cef88452-9bc9-496e-88d3-0fd9fd87d6f3 service nova] Creating event network-changed:8557bd0c-ae73-4af6-b470-984e296cdd16 for instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e on hv-cinder-83754 Jun 16 18:07:47.128802 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-ae5e536b-3bfe-427d-bb14-eeec711c2edf req-cef88452-9bc9-496e-88d3-0fd9fd87d6f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057665 Jun 16 18:07:47.130228 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 116/228] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:47.142221 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7cefc9a2-93cf-429e-bd7c-4aebd1080ec6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:47.142995 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7cefc9a2-93cf-429e-bd7c-4aebd1080ec6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:47.155766 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7cefc9a2-93cf-429e-bd7c-4aebd1080ec6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:47.156747 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7cefc9a2-93cf-429e-bd7c-4aebd1080ec6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:47.157891 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7cefc9a2-93cf-429e-bd7c-4aebd1080ec6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:47.158328 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7cefc9a2-93cf-429e-bd7c-4aebd1080ec6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:47.161524 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-49215d01-173b-42b6-bfcb-af60b94305f4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:47.172191 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-49215d01-173b-42b6-bfcb-af60b94305f4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1361 microversion: 2.1 time: 0.239497 Jun 16 18:07:47.173135 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 113/229] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:46 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:47.190678 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-13718f14-9466-408e-8add-540387f703fe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:47.190678 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-13718f14-9466-408e-8add-540387f703fe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:47.223827 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-13718f14-9466-408e-8add-540387f703fe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:47.224972 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-13718f14-9466-408e-8add-540387f703fe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:47.229611 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-13718f14-9466-408e-8add-540387f703fe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:47.230231 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-13718f14-9466-408e-8add-540387f703fe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:47.267899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7cefc9a2-93cf-429e-bd7c-4aebd1080ec6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:47.281654 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7cefc9a2-93cf-429e-bd7c-4aebd1080ec6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1266 microversion: 2.1 time: 0.148821 Jun 16 18:07:47.282501 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 117/230] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:47 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:47.288365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-49e579cf-2b35-483d-b207-c8e3f6a5c206 req-abd80724-7add-4416-bf2c-cf349d778836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279175ca-aad1-40da-a191-4712cbd17771", "name": "network-vif-plugged", "status": "completed", "tag": "d3e274fe-5d79-4687-9f75-5a8fd858ef61"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:47.313405 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-49e579cf-2b35-483d-b207-c8e3f6a5c206 req-abd80724-7add-4416-bf2c-cf349d778836 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:47.314918 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-49e579cf-2b35-483d-b207-c8e3f6a5c206 req-abd80724-7add-4416-bf2c-cf349d778836 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:47.331035 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-49e579cf-2b35-483d-b207-c8e3f6a5c206 req-abd80724-7add-4416-bf2c-cf349d778836 service nova] Creating event network-vif-plugged:d3e274fe-5d79-4687-9f75-5a8fd858ef61 for instance 279175ca-aad1-40da-a191-4712cbd17771 on hv-cinder-83754 Jun 16 18:07:47.343679 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-49e579cf-2b35-483d-b207-c8e3f6a5c206 req-abd80724-7add-4416-bf2c-cf349d778836 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059523 Jun 16 18:07:47.344918 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 118/231] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:47.430852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-13718f14-9466-408e-8add-540387f703fe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:47.440840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-13718f14-9466-408e-8add-540387f703fe tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.265859 Jun 16 18:07:47.441441 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 114/232] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:47 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:47.632598 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-4904421a-b497-46d8-8b6a-cfbe59728420 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:47.633411 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-4904421a-b497-46d8-8b6a-cfbe59728420 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:47.641160 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4904421a-b497-46d8-8b6a-cfbe59728420 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:47.641946 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4904421a-b497-46d8-8b6a-cfbe59728420 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:47.642896 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4904421a-b497-46d8-8b6a-cfbe59728420 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:47.643581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4904421a-b497-46d8-8b6a-cfbe59728420 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:47.817784 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4904421a-b497-46d8-8b6a-cfbe59728420 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:47.836969 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4904421a-b497-46d8-8b6a-cfbe59728420 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:47.838506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4904421a-b497-46d8-8b6a-cfbe59728420 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:47.840475 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-4904421a-b497-46d8-8b6a-cfbe59728420 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.213524 Jun 16 18:07:47.841046 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 119/233] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:47 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:48.194492 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e5de5c33-f84f-4f13-9c33-357e1ec65a8a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:48.198805 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e5de5c33-f84f-4f13-9c33-357e1ec65a8a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:48.214889 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e5de5c33-f84f-4f13-9c33-357e1ec65a8a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:48.215595 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e5de5c33-f84f-4f13-9c33-357e1ec65a8a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:48.216558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e5de5c33-f84f-4f13-9c33-357e1ec65a8a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:48.216996 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e5de5c33-f84f-4f13-9c33-357e1ec65a8a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:48.299762 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-de50aac2-7ed7-46c7-a942-fcb481cf832e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:48.300529 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-de50aac2-7ed7-46c7-a942-fcb481cf832e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:48.317304 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-de50aac2-7ed7-46c7-a942-fcb481cf832e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:48.319003 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-de50aac2-7ed7-46c7-a942-fcb481cf832e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:48.320007 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-de50aac2-7ed7-46c7-a942-fcb481cf832e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:48.320448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-de50aac2-7ed7-46c7-a942-fcb481cf832e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:48.403148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-de50aac2-7ed7-46c7-a942-fcb481cf832e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:48.422414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-de50aac2-7ed7-46c7-a942-fcb481cf832e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1266 microversion: 2.1 time: 0.115346 Jun 16 18:07:48.422414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 120/234] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:48 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:48.430817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e5de5c33-f84f-4f13-9c33-357e1ec65a8a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:48.439175 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e5de5c33-f84f-4f13-9c33-357e1ec65a8a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1547 microversion: 2.1 time: 0.248844 Jun 16 18:07:48.439878 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 115/235] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:48 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1547 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:48.458324 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-844e1765-fc1a-4a76-bd91-5c9073f794f6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:48.458887 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6d9bddf5-97d7-4109-9ece-465abc4ceda4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:48.459173 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-844e1765-fc1a-4a76-bd91-5c9073f794f6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:48.459398 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6d9bddf5-97d7-4109-9ece-465abc4ceda4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:48.466454 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6d9bddf5-97d7-4109-9ece-465abc4ceda4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:48.466901 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6d9bddf5-97d7-4109-9ece-465abc4ceda4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:48.467125 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-844e1765-fc1a-4a76-bd91-5c9073f794f6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:48.467708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6d9bddf5-97d7-4109-9ece-465abc4ceda4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:48.467814 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-844e1765-fc1a-4a76-bd91-5c9073f794f6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:48.468388 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6d9bddf5-97d7-4109-9ece-465abc4ceda4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:48.468885 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-844e1765-fc1a-4a76-bd91-5c9073f794f6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:48.469493 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-844e1765-fc1a-4a76-bd91-5c9073f794f6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:48.585368 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6d9bddf5-97d7-4109-9ece-465abc4ceda4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130316 Jun 16 18:07:48.586062 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 116/236] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jun 16 18:07:48 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:48.649428 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-844e1765-fc1a-4a76-bd91-5c9073f794f6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:48.660310 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-844e1765-fc1a-4a76-bd91-5c9073f794f6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.205949 Jun 16 18:07:48.703343 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 121/237] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:48 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:48.859206 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6abaed88-a70b-483f-b423-396b79cc6ff5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:48.863631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6abaed88-a70b-483f-b423-396b79cc6ff5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:48.866080 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=100 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:48.871918 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6abaed88-a70b-483f-b423-396b79cc6ff5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:48.872704 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6abaed88-a70b-483f-b423-396b79cc6ff5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:48.873504 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6abaed88-a70b-483f-b423-396b79cc6ff5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:48.873940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6abaed88-a70b-483f-b423-396b79cc6ff5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:49.041279 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6abaed88-a70b-483f-b423-396b79cc6ff5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:49.042027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6abaed88-a70b-483f-b423-396b79cc6ff5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:49.044395 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6abaed88-a70b-483f-b423-396b79cc6ff5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:49.046008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6abaed88-a70b-483f-b423-396b79cc6ff5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.191235 Jun 16 18:07:49.046603 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 117/238] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:48 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:49.434008 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6a4e2466-efa4-4ef5-8d40-92149a0009ee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:49.441200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6a4e2466-efa4-4ef5-8d40-92149a0009ee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:49.441756 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6a4e2466-efa4-4ef5-8d40-92149a0009ee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:49.442432 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6a4e2466-efa4-4ef5-8d40-92149a0009ee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:49.443459 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6a4e2466-efa4-4ef5-8d40-92149a0009ee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:49.444096 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6a4e2466-efa4-4ef5-8d40-92149a0009ee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:49.514361 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6a4e2466-efa4-4ef5-8d40-92149a0009ee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:49.523336 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6a4e2466-efa4-4ef5-8d40-92149a0009ee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1274 microversion: 2.1 time: 0.094011 Jun 16 18:07:49.523927 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 122/239] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:49 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:49.712659 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b7bf7546-aeb2-448b-9ee7-1173695b8af0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:49.713279 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b7bf7546-aeb2-448b-9ee7-1173695b8af0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:49.721956 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b7bf7546-aeb2-448b-9ee7-1173695b8af0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:49.722612 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b7bf7546-aeb2-448b-9ee7-1173695b8af0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:49.723423 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b7bf7546-aeb2-448b-9ee7-1173695b8af0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:49.724345 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b7bf7546-aeb2-448b-9ee7-1173695b8af0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:49.873568 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b7bf7546-aeb2-448b-9ee7-1173695b8af0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:49.882061 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b7bf7546-aeb2-448b-9ee7-1173695b8af0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.173182 Jun 16 18:07:49.892302 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 118/240] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:49 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:50.065277 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-873ab3fc-905b-44c4-a77c-baed306d655c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:50.066219 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-873ab3fc-905b-44c4-a77c-baed306d655c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:50.073438 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-873ab3fc-905b-44c4-a77c-baed306d655c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:50.074647 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-873ab3fc-905b-44c4-a77c-baed306d655c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:50.075713 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-873ab3fc-905b-44c4-a77c-baed306d655c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:50.077613 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-873ab3fc-905b-44c4-a77c-baed306d655c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:50.172971 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-1594350f-ed33-4a07-85f5-fb35bcbdf87b req-76ceed76-d96b-450b-bee1-be1421a5c05a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1134706f-4520-434d-877f-bc6465b3e282", "tag": "41a992ba-4fda-42d8-a121-3c7c2f9e6d3d"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:50.180542 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-1594350f-ed33-4a07-85f5-fb35bcbdf87b req-76ceed76-d96b-450b-bee1-be1421a5c05a service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:50.181273 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-1594350f-ed33-4a07-85f5-fb35bcbdf87b req-76ceed76-d96b-450b-bee1-be1421a5c05a service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:50.196447 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-1594350f-ed33-4a07-85f5-fb35bcbdf87b req-76ceed76-d96b-450b-bee1-be1421a5c05a service nova] Creating event network-changed:41a992ba-4fda-42d8-a121-3c7c2f9e6d3d for instance 1134706f-4520-434d-877f-bc6465b3e282 on hv-cinder-83754 Jun 16 18:07:50.202523 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-1594350f-ed33-4a07-85f5-fb35bcbdf87b req-76ceed76-d96b-450b-bee1-be1421a5c05a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034799 Jun 16 18:07:50.203810 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 119/241] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:07:50.233403 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-873ab3fc-905b-44c4-a77c-baed306d655c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:50.240998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-873ab3fc-905b-44c4-a77c-baed306d655c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:50.244302 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-873ab3fc-905b-44c4-a77c-baed306d655c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:50.245650 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-873ab3fc-905b-44c4-a77c-baed306d655c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.184637 Jun 16 18:07:50.246744 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 123/242] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:50 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:50.546733 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-48d2fe34-2023-47a6-a9a0-5118c11d9a8b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:50.547625 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-48d2fe34-2023-47a6-a9a0-5118c11d9a8b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:50.555015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-48d2fe34-2023-47a6-a9a0-5118c11d9a8b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:50.555781 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-48d2fe34-2023-47a6-a9a0-5118c11d9a8b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:50.556913 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-48d2fe34-2023-47a6-a9a0-5118c11d9a8b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:50.557529 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-48d2fe34-2023-47a6-a9a0-5118c11d9a8b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:50.647437 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-48d2fe34-2023-47a6-a9a0-5118c11d9a8b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:50.657970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-48d2fe34-2023-47a6-a9a0-5118c11d9a8b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1284 microversion: 2.1 time: 0.118341 Jun 16 18:07:50.658656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 120/243] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:50 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:50.900434 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5e200d4b-a8f5-4416-8e5f-447557902bd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:50.901144 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5e200d4b-a8f5-4416-8e5f-447557902bd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:50.908628 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5e200d4b-a8f5-4416-8e5f-447557902bd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:50.909078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5e200d4b-a8f5-4416-8e5f-447557902bd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:50.909848 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5e200d4b-a8f5-4416-8e5f-447557902bd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:50.910274 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5e200d4b-a8f5-4416-8e5f-447557902bd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:51.112019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5e200d4b-a8f5-4416-8e5f-447557902bd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:51.123588 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5e200d4b-a8f5-4416-8e5f-447557902bd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.228526 Jun 16 18:07:51.129508 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 124/244] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:50 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:51.265958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4e35bd18-2e8c-4c6d-bfbf-1c50411c34b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:51.266625 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4e35bd18-2e8c-4c6d-bfbf-1c50411c34b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:51.273373 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4e35bd18-2e8c-4c6d-bfbf-1c50411c34b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:51.273800 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4e35bd18-2e8c-4c6d-bfbf-1c50411c34b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:51.274561 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4e35bd18-2e8c-4c6d-bfbf-1c50411c34b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:51.274990 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4e35bd18-2e8c-4c6d-bfbf-1c50411c34b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:51.280451 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=100 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:51.469608 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4e35bd18-2e8c-4c6d-bfbf-1c50411c34b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:51.477878 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4e35bd18-2e8c-4c6d-bfbf-1c50411c34b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:51.479410 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4e35bd18-2e8c-4c6d-bfbf-1c50411c34b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:51.480508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4e35bd18-2e8c-4c6d-bfbf-1c50411c34b4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.218694 Jun 16 18:07:51.481096 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 121/245] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:51 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:51.674941 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e11e376d-605b-47cc-9530-9bc1cd44fe4b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:51.675613 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e11e376d-605b-47cc-9530-9bc1cd44fe4b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:51.681914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e11e376d-605b-47cc-9530-9bc1cd44fe4b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:51.682361 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e11e376d-605b-47cc-9530-9bc1cd44fe4b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:51.683118 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e11e376d-605b-47cc-9530-9bc1cd44fe4b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:51.683583 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e11e376d-605b-47cc-9530-9bc1cd44fe4b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:51.882181 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e11e376d-605b-47cc-9530-9bc1cd44fe4b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:51.889843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e11e376d-605b-47cc-9530-9bc1cd44fe4b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1326 microversion: 2.1 time: 0.218740 Jun 16 18:07:51.890405 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 125/246] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:51 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1326 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:52.141914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-82f5471d-5baa-41f5-a265-c5dfac5c98d7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:52.142598 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-82f5471d-5baa-41f5-a265-c5dfac5c98d7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:52.148975 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-82f5471d-5baa-41f5-a265-c5dfac5c98d7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:52.150567 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-82f5471d-5baa-41f5-a265-c5dfac5c98d7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:52.150567 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-82f5471d-5baa-41f5-a265-c5dfac5c98d7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:52.150567 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-82f5471d-5baa-41f5-a265-c5dfac5c98d7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:52.288691 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-82f5471d-5baa-41f5-a265-c5dfac5c98d7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:52.296756 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-82f5471d-5baa-41f5-a265-c5dfac5c98d7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.159864 Jun 16 18:07:52.303754 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 122/247] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:52 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:52.507163 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1c7c1eab-fa8b-4621-aba0-f05ecd811798 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:52.507163 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1c7c1eab-fa8b-4621-aba0-f05ecd811798 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:52.507163 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c7c1eab-fa8b-4621-aba0-f05ecd811798 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:52.507851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c7c1eab-fa8b-4621-aba0-f05ecd811798 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:52.508407 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c7c1eab-fa8b-4621-aba0-f05ecd811798 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:52.508917 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c7c1eab-fa8b-4621-aba0-f05ecd811798 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:52.721769 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1c7c1eab-fa8b-4621-aba0-f05ecd811798 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:52.731270 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1c7c1eab-fa8b-4621-aba0-f05ecd811798 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:52.733158 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1c7c1eab-fa8b-4621-aba0-f05ecd811798 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:52.734663 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1c7c1eab-fa8b-4621-aba0-f05ecd811798 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1406 microversion: 2.20 time: 0.240541 Jun 16 18:07:52.735407 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 126/248] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:52 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:52.906534 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f7fcdb23-9ac0-4bc2-80af-e5a42d8bc29c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:52.907359 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f7fcdb23-9ac0-4bc2-80af-e5a42d8bc29c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:52.913443 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f7fcdb23-9ac0-4bc2-80af-e5a42d8bc29c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:52.913893 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f7fcdb23-9ac0-4bc2-80af-e5a42d8bc29c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:52.914661 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f7fcdb23-9ac0-4bc2-80af-e5a42d8bc29c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:52.915101 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f7fcdb23-9ac0-4bc2-80af-e5a42d8bc29c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:53.092636 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f7fcdb23-9ac0-4bc2-80af-e5a42d8bc29c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:53.101761 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f7fcdb23-9ac0-4bc2-80af-e5a42d8bc29c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1326 microversion: 2.1 time: 0.198993 Jun 16 18:07:53.102608 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 123/249] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:52 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1326 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:53.321170 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1f762f15-d143-4264-92ca-46a71487fa3b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:53.323109 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1f762f15-d143-4264-92ca-46a71487fa3b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:53.334513 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1f762f15-d143-4264-92ca-46a71487fa3b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:53.334959 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1f762f15-d143-4264-92ca-46a71487fa3b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:53.335737 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1f762f15-d143-4264-92ca-46a71487fa3b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:53.336161 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1f762f15-d143-4264-92ca-46a71487fa3b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:53.473097 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1f762f15-d143-4264-92ca-46a71487fa3b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:53.486492 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1f762f15-d143-4264-92ca-46a71487fa3b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.173139 Jun 16 18:07:53.487205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 127/250] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:53 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:53.516977 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-63e77932-269d-4b51-a8d2-497d83a8c9fb req-0b6dc5c1-9c41-4538-bb3f-f87cd49db343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bdc610c-c258-4879-899c-f419cb005762", "tag": "e91c2f6f-cfce-4c6e-88e2-ee89ed30902d"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:53.537235 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-63e77932-269d-4b51-a8d2-497d83a8c9fb req-0b6dc5c1-9c41-4538-bb3f-f87cd49db343 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:53.543702 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-63e77932-269d-4b51-a8d2-497d83a8c9fb req-0b6dc5c1-9c41-4538-bb3f-f87cd49db343 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:53.563460 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-63e77932-269d-4b51-a8d2-497d83a8c9fb req-0b6dc5c1-9c41-4538-bb3f-f87cd49db343 service nova] Creating event network-changed:e91c2f6f-cfce-4c6e-88e2-ee89ed30902d for instance 2bdc610c-c258-4879-899c-f419cb005762 on hv-cinder-83754 Jun 16 18:07:53.569647 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-63e77932-269d-4b51-a8d2-497d83a8c9fb req-0b6dc5c1-9c41-4538-bb3f-f87cd49db343 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057528 Jun 16 18:07:53.576457 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 124/251] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:07:53.754195 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-46a7361e-4f71-400b-af90-d74c13a5dce6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:53.754763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-46a7361e-4f71-400b-af90-d74c13a5dce6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:53.756959 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:53.761834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-46a7361e-4f71-400b-af90-d74c13a5dce6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:53.762978 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-46a7361e-4f71-400b-af90-d74c13a5dce6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:53.763508 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-46a7361e-4f71-400b-af90-d74c13a5dce6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:53.763964 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-46a7361e-4f71-400b-af90-d74c13a5dce6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:53.901075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-46a7361e-4f71-400b-af90-d74c13a5dce6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:53.909019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-46a7361e-4f71-400b-af90-d74c13a5dce6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:53.914603 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-46a7361e-4f71-400b-af90-d74c13a5dce6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:53.914603 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-46a7361e-4f71-400b-af90-d74c13a5dce6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1598 microversion: 2.20 time: 0.161660 Jun 16 18:07:53.914603 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 128/252] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:07:53 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1598 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:07:53.927849 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:53.932265 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a9af85f5-b362-4bde-85c5-ee8e3dd8540a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:53.932836 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a9af85f5-b362-4bde-85c5-ee8e3dd8540a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:53.939971 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a9af85f5-b362-4bde-85c5-ee8e3dd8540a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:53.940419 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a9af85f5-b362-4bde-85c5-ee8e3dd8540a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:53.941173 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a9af85f5-b362-4bde-85c5-ee8e3dd8540a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:53.941641 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a9af85f5-b362-4bde-85c5-ee8e3dd8540a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:54.021336 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a9af85f5-b362-4bde-85c5-ee8e3dd8540a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094207 Jun 16 18:07:54.021967 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 125/253] 10.222.0.58 () {60 vars in 1315 bytes} [Thu Jun 16 18:07:53 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:07:54.120362 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5a5fb5b6-cd19-43e4-babe-7cc3c275527f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:54.121411 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5a5fb5b6-cd19-43e4-babe-7cc3c275527f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:54.138578 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5a5fb5b6-cd19-43e4-babe-7cc3c275527f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:54.138578 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5a5fb5b6-cd19-43e4-babe-7cc3c275527f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:54.138578 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5a5fb5b6-cd19-43e4-babe-7cc3c275527f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:54.138578 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5a5fb5b6-cd19-43e4-babe-7cc3c275527f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:54.447520 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5a5fb5b6-cd19-43e4-babe-7cc3c275527f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:54.460231 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5a5fb5b6-cd19-43e4-babe-7cc3c275527f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.343502 Jun 16 18:07:54.462805 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 129/254] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:54 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:54.503646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f448131f-9147-4929-a0ed-6881f97e9da3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:54.504266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f448131f-9147-4929-a0ed-6881f97e9da3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:54.514931 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f448131f-9147-4929-a0ed-6881f97e9da3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:54.517943 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f448131f-9147-4929-a0ed-6881f97e9da3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:54.517943 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f448131f-9147-4929-a0ed-6881f97e9da3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:54.521993 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f448131f-9147-4929-a0ed-6881f97e9da3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:54.917261 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2e8d5c70-6981-473e-b296-e6a67b5c2eb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:54.917771 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2e8d5c70-6981-473e-b296-e6a67b5c2eb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:54.925468 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e8d5c70-6981-473e-b296-e6a67b5c2eb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:54.926385 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e8d5c70-6981-473e-b296-e6a67b5c2eb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:54.927680 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e8d5c70-6981-473e-b296-e6a67b5c2eb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:54.928116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e8d5c70-6981-473e-b296-e6a67b5c2eb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:54.935103 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=8 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:54.979738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2e8d5c70-6981-473e-b296-e6a67b5c2eb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Going to try to terminate instance {{(pid=118161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:07:55.154767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f448131f-9147-4929-a0ed-6881f97e9da3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:55.165868 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f448131f-9147-4929-a0ed-6881f97e9da3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.665160 Jun 16 18:07:55.165868 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 126/255] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:54 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:55.439280 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2e8d5c70-6981-473e-b296-e6a67b5c2eb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "DELETE /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 204 len: 0 microversion: 2.1 time: 0.524981 Jun 16 18:07:55.441437 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 130/256] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:07:54 2022] DELETE /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:07:55.451159 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-59f18b99-1cf6-43de-94a5-db819f6daf6b tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:55.451703 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-59f18b99-1cf6-43de-94a5-db819f6daf6b tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:55.458480 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-59f18b99-1cf6-43de-94a5-db819f6daf6b tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:55.458944 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-59f18b99-1cf6-43de-94a5-db819f6daf6b tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:55.459804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-59f18b99-1cf6-43de-94a5-db819f6daf6b tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:55.460265 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-59f18b99-1cf6-43de-94a5-db819f6daf6b tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:55.483623 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-532bcdf8-4e6f-4e9b-9b82-7670f8ba0684 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:55.484624 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-532bcdf8-4e6f-4e9b-9b82-7670f8ba0684 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:55.495607 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-532bcdf8-4e6f-4e9b-9b82-7670f8ba0684 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:55.499592 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-532bcdf8-4e6f-4e9b-9b82-7670f8ba0684 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:55.500606 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-532bcdf8-4e6f-4e9b-9b82-7670f8ba0684 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:55.501058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-532bcdf8-4e6f-4e9b-9b82-7670f8ba0684 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:55.801555 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-59f18b99-1cf6-43de-94a5-db819f6daf6b tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:55.809139 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-532bcdf8-4e6f-4e9b-9b82-7670f8ba0684 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:55.813718 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-59f18b99-1cf6-43de-94a5-db819f6daf6b tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1553 microversion: 2.1 time: 0.368248 Jun 16 18:07:55.817825 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:07:55.820552 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-532bcdf8-4e6f-4e9b-9b82-7670f8ba0684 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.342122 Jun 16 18:07:55.827101 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 131/257] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:55 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:55.827234 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 127/258] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:55 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1553 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:56.002676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-c3841ba1-b895-45be-99ac-5a2b81ad0a87 req-cd62edeb-2b51-4dab-8a9c-188080117fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "279175ca-aad1-40da-a191-4712cbd17771", "tag": "d3e274fe-5d79-4687-9f75-5a8fd858ef61"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:07:56.011338 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-c3841ba1-b895-45be-99ac-5a2b81ad0a87 req-cd62edeb-2b51-4dab-8a9c-188080117fc8 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:56.011805 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-c3841ba1-b895-45be-99ac-5a2b81ad0a87 req-cd62edeb-2b51-4dab-8a9c-188080117fc8 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:56.023588 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-c3841ba1-b895-45be-99ac-5a2b81ad0a87 req-cd62edeb-2b51-4dab-8a9c-188080117fc8 service nova] Creating event network-changed:d3e274fe-5d79-4687-9f75-5a8fd858ef61 for instance 279175ca-aad1-40da-a191-4712cbd17771 on hv-cinder-83754 Jun 16 18:07:56.028422 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-c3841ba1-b895-45be-99ac-5a2b81ad0a87 req-cd62edeb-2b51-4dab-8a9c-188080117fc8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030227 Jun 16 18:07:56.030234 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 132/259] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:07:56.182060 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1a8bd176-a780-471d-88ea-1e92996eb044 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:56.182675 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1a8bd176-a780-471d-88ea-1e92996eb044 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:56.189127 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a8bd176-a780-471d-88ea-1e92996eb044 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:56.189578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a8bd176-a780-471d-88ea-1e92996eb044 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:56.190620 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a8bd176-a780-471d-88ea-1e92996eb044 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:56.191222 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a8bd176-a780-471d-88ea-1e92996eb044 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:56.354544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1a8bd176-a780-471d-88ea-1e92996eb044 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:56.362905 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1a8bd176-a780-471d-88ea-1e92996eb044 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.184620 Jun 16 18:07:56.363452 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 128/260] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:56 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:56.830967 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-bdbe0dff-93cf-4598-acc2-ab690bf16a58 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:56.832115 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-bdbe0dff-93cf-4598-acc2-ab690bf16a58 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:56.840874 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bdbe0dff-93cf-4598-acc2-ab690bf16a58 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:56.841438 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bdbe0dff-93cf-4598-acc2-ab690bf16a58 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:56.842392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bdbe0dff-93cf-4598-acc2-ab690bf16a58 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:56.842899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bdbe0dff-93cf-4598-acc2-ab690bf16a58 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:56.843954 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a96417ba-ba2f-4bc4-b514-a4a4b18a5b08 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:56.844600 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a96417ba-ba2f-4bc4-b514-a4a4b18a5b08 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:56.851719 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a96417ba-ba2f-4bc4-b514-a4a4b18a5b08 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:56.859922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a96417ba-ba2f-4bc4-b514-a4a4b18a5b08 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:56.859922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a96417ba-ba2f-4bc4-b514-a4a4b18a5b08 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:56.859922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a96417ba-ba2f-4bc4-b514-a4a4b18a5b08 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:57.065683 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-bdbe0dff-93cf-4598-acc2-ab690bf16a58 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:57.076057 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-bdbe0dff-93cf-4598-acc2-ab690bf16a58 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1553 microversion: 2.1 time: 0.249420 Jun 16 18:07:57.076901 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 133/261] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:56 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1553 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:57.110236 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a96417ba-ba2f-4bc4-b514-a4a4b18a5b08 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:57.117770 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a96417ba-ba2f-4bc4-b514-a4a4b18a5b08 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.278702 Jun 16 18:07:57.118341 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 129/262] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:56 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:57.386335 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-625f3354-e92f-486d-811c-bdaaabab17da tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:57.386931 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-625f3354-e92f-486d-811c-bdaaabab17da tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:57.395457 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-625f3354-e92f-486d-811c-bdaaabab17da tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:57.395719 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-625f3354-e92f-486d-811c-bdaaabab17da tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:57.396466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-625f3354-e92f-486d-811c-bdaaabab17da tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:57.396893 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-625f3354-e92f-486d-811c-bdaaabab17da tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:57.539117 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-625f3354-e92f-486d-811c-bdaaabab17da tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:57.548173 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-625f3354-e92f-486d-811c-bdaaabab17da tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.165373 Jun 16 18:07:57.559234 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 134/263] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:57 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:58.094094 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-127b9b23-f2d7-4b32-ad4d-ea3213c8e4b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:58.094831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-127b9b23-f2d7-4b32-ad4d-ea3213c8e4b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:58.101498 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-127b9b23-f2d7-4b32-ad4d-ea3213c8e4b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:58.101951 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-127b9b23-f2d7-4b32-ad4d-ea3213c8e4b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:58.102716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-127b9b23-f2d7-4b32-ad4d-ea3213c8e4b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:58.103148 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-127b9b23-f2d7-4b32-ad4d-ea3213c8e4b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:58.135879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-4f4f94f8-05d7-489c-a966-83311871d398 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:58.136962 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-4f4f94f8-05d7-489c-a966-83311871d398 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:58.144370 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4f4f94f8-05d7-489c-a966-83311871d398 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:58.145097 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4f4f94f8-05d7-489c-a966-83311871d398 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:58.145953 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4f4f94f8-05d7-489c-a966-83311871d398 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:58.146581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4f4f94f8-05d7-489c-a966-83311871d398 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:58.310069 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-127b9b23-f2d7-4b32-ad4d-ea3213c8e4b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:58.318635 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-127b9b23-f2d7-4b32-ad4d-ea3213c8e4b1 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1553 microversion: 2.1 time: 0.228881 Jun 16 18:07:58.319647 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 130/264] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:58 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:58.336322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4f4f94f8-05d7-489c-a966-83311871d398 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:58.345071 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-4f4f94f8-05d7-489c-a966-83311871d398 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.213555 Jun 16 18:07:58.345633 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 135/265] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:58 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:58.565966 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c4799fea-7ee4-406d-82f1-1362f2ac3914 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:58.566578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c4799fea-7ee4-406d-82f1-1362f2ac3914 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:58.572854 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c4799fea-7ee4-406d-82f1-1362f2ac3914 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:58.573304 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c4799fea-7ee4-406d-82f1-1362f2ac3914 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:58.574057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c4799fea-7ee4-406d-82f1-1362f2ac3914 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:58.574489 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c4799fea-7ee4-406d-82f1-1362f2ac3914 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:58.713123 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c4799fea-7ee4-406d-82f1-1362f2ac3914 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:58.721522 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c4799fea-7ee4-406d-82f1-1362f2ac3914 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.159998 Jun 16 18:07:58.722692 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 131/266] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:58 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:59.337645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0593729d-b19a-4026-b02f-54eb455420ee tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:59.338198 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0593729d-b19a-4026-b02f-54eb455420ee tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:59.345603 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0593729d-b19a-4026-b02f-54eb455420ee tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:59.346141 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0593729d-b19a-4026-b02f-54eb455420ee tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:59.346918 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0593729d-b19a-4026-b02f-54eb455420ee tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:59.347390 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0593729d-b19a-4026-b02f-54eb455420ee tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:59.367708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1a58b6c6-2549-4233-979f-8813e8923537 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:59.367708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1a58b6c6-2549-4233-979f-8813e8923537 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:59.371008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a58b6c6-2549-4233-979f-8813e8923537 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:59.371644 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a58b6c6-2549-4233-979f-8813e8923537 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:59.372436 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a58b6c6-2549-4233-979f-8813e8923537 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:59.372868 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a58b6c6-2549-4233-979f-8813e8923537 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:59.565092 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0593729d-b19a-4026-b02f-54eb455420ee tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:59.573466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0593729d-b19a-4026-b02f-54eb455420ee tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1553 microversion: 2.1 time: 0.240798 Jun 16 18:07:59.574169 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 136/267] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:59 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:07:59.580120 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1a58b6c6-2549-4233-979f-8813e8923537 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:59.595042 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1a58b6c6-2549-4233-979f-8813e8923537 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.236085 Jun 16 18:07:59.595797 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 132/268] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:59 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:07:59.739282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9735d527-6f8e-4553-81e9-11e9ffbba3eb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:07:59.739920 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9735d527-6f8e-4553-81e9-11e9ffbba3eb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:07:59.745854 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9735d527-6f8e-4553-81e9-11e9ffbba3eb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:59.746294 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9735d527-6f8e-4553-81e9-11e9ffbba3eb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:59.747041 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9735d527-6f8e-4553-81e9-11e9ffbba3eb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:07:59.747515 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9735d527-6f8e-4553-81e9-11e9ffbba3eb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:07:59.881955 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9735d527-6f8e-4553-81e9-11e9ffbba3eb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:07:59.890111 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9735d527-6f8e-4553-81e9-11e9ffbba3eb tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.154638 Jun 16 18:07:59.890695 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 137/269] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:07:59 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:00.590568 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6da3b5ab-06cf-47ce-a5ab-f5242734c8b6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:00.591169 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6da3b5ab-06cf-47ce-a5ab-f5242734c8b6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:00.598310 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6da3b5ab-06cf-47ce-a5ab-f5242734c8b6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:00.598753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6da3b5ab-06cf-47ce-a5ab-f5242734c8b6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:00.599561 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6da3b5ab-06cf-47ce-a5ab-f5242734c8b6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:00.599994 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6da3b5ab-06cf-47ce-a5ab-f5242734c8b6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:00.612486 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ccf943c4-c7c9-47c5-9408-6240cecd0c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:00.613207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ccf943c4-c7c9-47c5-9408-6240cecd0c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:00.620418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ccf943c4-c7c9-47c5-9408-6240cecd0c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:00.620973 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ccf943c4-c7c9-47c5-9408-6240cecd0c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:00.621932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ccf943c4-c7c9-47c5-9408-6240cecd0c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:00.622366 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ccf943c4-c7c9-47c5-9408-6240cecd0c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:00.799498 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6da3b5ab-06cf-47ce-a5ab-f5242734c8b6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:00.808801 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6da3b5ab-06cf-47ce-a5ab-f5242734c8b6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1553 microversion: 2.1 time: 0.222054 Jun 16 18:08:00.809376 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 133/270] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:00 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1553 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:00.812319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ccf943c4-c7c9-47c5-9408-6240cecd0c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:00.819691 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ccf943c4-c7c9-47c5-9408-6240cecd0c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.211212 Jun 16 18:08:00.820253 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 138/271] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:00 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:00.907112 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3b89b185-08d5-4fea-83cc-28590523f12e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:00.907746 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3b89b185-08d5-4fea-83cc-28590523f12e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:00.913796 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3b89b185-08d5-4fea-83cc-28590523f12e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:00.914249 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3b89b185-08d5-4fea-83cc-28590523f12e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:00.915002 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3b89b185-08d5-4fea-83cc-28590523f12e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:00.915460 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3b89b185-08d5-4fea-83cc-28590523f12e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:01.050803 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3b89b185-08d5-4fea-83cc-28590523f12e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:01.058790 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3b89b185-08d5-4fea-83cc-28590523f12e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.155512 Jun 16 18:08:01.059359 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 134/272] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:00 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:01.826416 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b77091f9-eda5-4ac2-b80d-acb8c9806197 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:01.827386 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b77091f9-eda5-4ac2-b80d-acb8c9806197 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:01.834127 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b77091f9-eda5-4ac2-b80d-acb8c9806197 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:01.834573 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b77091f9-eda5-4ac2-b80d-acb8c9806197 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:01.835340 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b77091f9-eda5-4ac2-b80d-acb8c9806197 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:01.835795 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b77091f9-eda5-4ac2-b80d-acb8c9806197 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:01.836811 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-82415520-5b2e-41d1-b4a4-aaacfef113a9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:01.837426 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-82415520-5b2e-41d1-b4a4-aaacfef113a9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:01.844598 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-82415520-5b2e-41d1-b4a4-aaacfef113a9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:01.845024 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-82415520-5b2e-41d1-b4a4-aaacfef113a9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:01.845801 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-82415520-5b2e-41d1-b4a4-aaacfef113a9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:01.846237 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-82415520-5b2e-41d1-b4a4-aaacfef113a9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:02.052649 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-82415520-5b2e-41d1-b4a4-aaacfef113a9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:02.065293 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-82415520-5b2e-41d1-b4a4-aaacfef113a9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.232214 Jun 16 18:08:02.066395 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 135/273] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:01 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:02.078747 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b77091f9-eda5-4ac2-b80d-acb8c9806197 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:02.082502 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b8077feb-0c8d-4fa1-8d65-8523f93f2ef8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:02.083204 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b8077feb-0c8d-4fa1-8d65-8523f93f2ef8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:02.088319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b77091f9-eda5-4ac2-b80d-acb8c9806197 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1553 microversion: 2.1 time: 0.265903 Jun 16 18:08:02.088937 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 139/274] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:01 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1553 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:02.089581 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8077feb-0c8d-4fa1-8d65-8523f93f2ef8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:02.090106 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8077feb-0c8d-4fa1-8d65-8523f93f2ef8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:02.090876 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8077feb-0c8d-4fa1-8d65-8523f93f2ef8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:02.091305 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8077feb-0c8d-4fa1-8d65-8523f93f2ef8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:02.238210 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b8077feb-0c8d-4fa1-8d65-8523f93f2ef8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:02.246365 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b8077feb-0c8d-4fa1-8d65-8523f93f2ef8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.168322 Jun 16 18:08:02.246946 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 136/275] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:02 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:02.451013 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-03d06461-0777-473f-b24c-d7b3f83dd667 req-c422df1e-6a5f-4bbf-8833-73585dbc38a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91383053-09e9-4294-86b1-ba106512b82f", "name": "network-vif-deleted", "tag": "8f397e6e-f2ca-4cbf-a4ea-14613d40280b"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:08:02.460198 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-03d06461-0777-473f-b24c-d7b3f83dd667 req-c422df1e-6a5f-4bbf-8833-73585dbc38a2 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:02.460634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-03d06461-0777-473f-b24c-d7b3f83dd667 req-c422df1e-6a5f-4bbf-8833-73585dbc38a2 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:02.473461 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-03d06461-0777-473f-b24c-d7b3f83dd667 req-c422df1e-6a5f-4bbf-8833-73585dbc38a2 service nova] Creating event network-vif-deleted:8f397e6e-f2ca-4cbf-a4ea-14613d40280b for instance 91383053-09e9-4294-86b1-ba106512b82f on hv-cinder-83754 Jun 16 18:08:02.478281 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-03d06461-0777-473f-b24c-d7b3f83dd667 req-c422df1e-6a5f-4bbf-8833-73585dbc38a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030741 Jun 16 18:08:02.478816 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 140/276] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:08:03.086429 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c9f4b883-9010-4e17-bc28-5b59b46cbe0b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:03.087059 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c9f4b883-9010-4e17-bc28-5b59b46cbe0b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:03.096175 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c9f4b883-9010-4e17-bc28-5b59b46cbe0b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:03.098747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c9f4b883-9010-4e17-bc28-5b59b46cbe0b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:03.098747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c9f4b883-9010-4e17-bc28-5b59b46cbe0b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:03.098747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c9f4b883-9010-4e17-bc28-5b59b46cbe0b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:03.106264 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-07ee91e4-b1d1-48d5-810f-1ba82eb32bb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:03.106997 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-07ee91e4-b1d1-48d5-810f-1ba82eb32bb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:03.114325 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07ee91e4-b1d1-48d5-810f-1ba82eb32bb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:03.114836 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07ee91e4-b1d1-48d5-810f-1ba82eb32bb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:03.115542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07ee91e4-b1d1-48d5-810f-1ba82eb32bb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:03.115961 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07ee91e4-b1d1-48d5-810f-1ba82eb32bb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:03.204248 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-07ee91e4-b1d1-48d5-810f-1ba82eb32bb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:03.217161 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-07ee91e4-b1d1-48d5-810f-1ba82eb32bb0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1346 microversion: 2.1 time: 0.114704 Jun 16 18:08:03.218191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 141/277] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:03 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:03.264417 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-084f4d11-ccfa-429b-92ec-605b81cedd33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:03.265410 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-084f4d11-ccfa-429b-92ec-605b81cedd33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:03.272731 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-084f4d11-ccfa-429b-92ec-605b81cedd33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:03.273169 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-084f4d11-ccfa-429b-92ec-605b81cedd33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:03.273931 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-084f4d11-ccfa-429b-92ec-605b81cedd33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:03.274353 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-084f4d11-ccfa-429b-92ec-605b81cedd33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:03.313411 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c9f4b883-9010-4e17-bc28-5b59b46cbe0b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:03.319873 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c9f4b883-9010-4e17-bc28-5b59b46cbe0b tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.237409 Jun 16 18:08:03.330446 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 137/278] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:03 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:03.445588 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-084f4d11-ccfa-429b-92ec-605b81cedd33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:03.453696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-084f4d11-ccfa-429b-92ec-605b81cedd33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.192711 Jun 16 18:08:03.454180 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 142/279] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:03 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:04.236252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2f6ee57d-8079-4e26-bcb2-91a89dfcfd7c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:04.236870 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2f6ee57d-8079-4e26-bcb2-91a89dfcfd7c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:04.243191 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f6ee57d-8079-4e26-bcb2-91a89dfcfd7c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:04.243723 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f6ee57d-8079-4e26-bcb2-91a89dfcfd7c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:04.244511 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f6ee57d-8079-4e26-bcb2-91a89dfcfd7c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:04.244952 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f6ee57d-8079-4e26-bcb2-91a89dfcfd7c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:04.276809 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f6ee57d-8079-4e26-bcb2-91a89dfcfd7c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:04.277296 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f6ee57d-8079-4e26-bcb2-91a89dfcfd7c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:04.277747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-2f6ee57d-8079-4e26-bcb2-91a89dfcfd7c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lazy-loading 'fault' on Instance uuid 91383053-09e9-4294-86b1-ba106512b82f {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:08:04.283447 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=100 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:04.322196 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2f6ee57d-8079-4e26-bcb2-91a89dfcfd7c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:04.331150 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2f6ee57d-8079-4e26-bcb2-91a89dfcfd7c tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1351 microversion: 2.1 time: 0.099693 Jun 16 18:08:04.331756 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 138/280] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:04 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:04.337129 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-4ef91003-6408-4e20-bd0c-6a382fa63ffc tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:04.337740 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-4ef91003-6408-4e20-bd0c-6a382fa63ffc tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:04.344521 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4ef91003-6408-4e20-bd0c-6a382fa63ffc tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:04.345171 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4ef91003-6408-4e20-bd0c-6a382fa63ffc tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:04.345934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4ef91003-6408-4e20-bd0c-6a382fa63ffc tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:04.346366 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4ef91003-6408-4e20-bd0c-6a382fa63ffc tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:04.471299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3572a378-ab67-46fd-9522-50f1d17083c2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:04.471941 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3572a378-ab67-46fd-9522-50f1d17083c2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:04.478373 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3572a378-ab67-46fd-9522-50f1d17083c2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:04.478825 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3572a378-ab67-46fd-9522-50f1d17083c2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:04.479650 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3572a378-ab67-46fd-9522-50f1d17083c2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:04.479808 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4ef91003-6408-4e20-bd0c-6a382fa63ffc tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:04.480073 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3572a378-ab67-46fd-9522-50f1d17083c2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:04.487811 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-4ef91003-6408-4e20-bd0c-6a382fa63ffc tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.154413 Jun 16 18:08:04.488379 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 143/281] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:04 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:04.616652 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3572a378-ab67-46fd-9522-50f1d17083c2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:04.624148 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3572a378-ab67-46fd-9522-50f1d17083c2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.157995 Jun 16 18:08:04.624716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 139/282] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:04 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:05.349815 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9077793e-77d7-484c-93d8-b106ffb8f2ae tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:05.351031 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9077793e-77d7-484c-93d8-b106ffb8f2ae tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:05.357284 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9077793e-77d7-484c-93d8-b106ffb8f2ae tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:05.357720 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9077793e-77d7-484c-93d8-b106ffb8f2ae tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:05.358468 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9077793e-77d7-484c-93d8-b106ffb8f2ae tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:05.358889 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9077793e-77d7-484c-93d8-b106ffb8f2ae tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:05.401649 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9077793e-77d7-484c-93d8-b106ffb8f2ae tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:05.402332 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9077793e-77d7-484c-93d8-b106ffb8f2ae tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:05.402785 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-9077793e-77d7-484c-93d8-b106ffb8f2ae tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lazy-loading 'fault' on Instance uuid 91383053-09e9-4294-86b1-ba106512b82f {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:08:05.457085 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-6a72ed78-584e-49b3-ae4b-a375b1d4b6c2 req-2e673dd6-82d0-48d2-b850-1203d23d71c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdc610c-c258-4879-899c-f419cb005762", "name": "network-vif-plugged", "status": "completed", "tag": "e91c2f6f-cfce-4c6e-88e2-ee89ed30902d"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:08:05.463572 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9077793e-77d7-484c-93d8-b106ffb8f2ae tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:05.476314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9077793e-77d7-484c-93d8-b106ffb8f2ae tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1351 microversion: 2.1 time: 0.131824 Jun 16 18:08:05.476850 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 144/283] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:05 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:05.479737 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-6a72ed78-584e-49b3-ae4b-a375b1d4b6c2 req-2e673dd6-82d0-48d2-b850-1203d23d71c9 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:05.480340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-6a72ed78-584e-49b3-ae4b-a375b1d4b6c2 req-2e673dd6-82d0-48d2-b850-1203d23d71c9 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:05.493571 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-6a72ed78-584e-49b3-ae4b-a375b1d4b6c2 req-2e673dd6-82d0-48d2-b850-1203d23d71c9 service nova] Creating event network-vif-plugged:e91c2f6f-cfce-4c6e-88e2-ee89ed30902d for instance 2bdc610c-c258-4879-899c-f419cb005762 on hv-cinder-83754 Jun 16 18:08:05.499221 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-6a72ed78-584e-49b3-ae4b-a375b1d4b6c2 req-2e673dd6-82d0-48d2-b850-1203d23d71c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045961 Jun 16 18:08:05.504067 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 140/284] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:08:05.505165 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-da96126c-1b25-46bc-b429-25ce30665285 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:05.506040 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-da96126c-1b25-46bc-b429-25ce30665285 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:05.512140 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-da96126c-1b25-46bc-b429-25ce30665285 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:05.512581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-da96126c-1b25-46bc-b429-25ce30665285 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:05.513405 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-da96126c-1b25-46bc-b429-25ce30665285 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:05.513835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-da96126c-1b25-46bc-b429-25ce30665285 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:05.646907 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4d377783-6f7d-43e1-a51a-e8d66b2afea4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:05.647814 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4d377783-6f7d-43e1-a51a-e8d66b2afea4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:05.655397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4d377783-6f7d-43e1-a51a-e8d66b2afea4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:05.655894 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4d377783-6f7d-43e1-a51a-e8d66b2afea4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:05.657508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4d377783-6f7d-43e1-a51a-e8d66b2afea4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:05.658245 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4d377783-6f7d-43e1-a51a-e8d66b2afea4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:05.942333 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-da96126c-1b25-46bc-b429-25ce30665285 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:05.951621 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-da96126c-1b25-46bc-b429-25ce30665285 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.450819 Jun 16 18:08:05.952200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 145/285] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:05 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:06.047586 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4d377783-6f7d-43e1-a51a-e8d66b2afea4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:06.056674 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4d377783-6f7d-43e1-a51a-e8d66b2afea4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.417987 Jun 16 18:08:06.067050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 141/286] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:05 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:06.493828 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-96f99beb-f5ce-4957-9379-006ca33f3615 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:06.494440 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-96f99beb-f5ce-4957-9379-006ca33f3615 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:06.500448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96f99beb-f5ce-4957-9379-006ca33f3615 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:06.500900 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96f99beb-f5ce-4957-9379-006ca33f3615 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:06.501660 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96f99beb-f5ce-4957-9379-006ca33f3615 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:06.502146 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96f99beb-f5ce-4957-9379-006ca33f3615 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:06.535305 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96f99beb-f5ce-4957-9379-006ca33f3615 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:06.535884 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96f99beb-f5ce-4957-9379-006ca33f3615 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:06.536406 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-96f99beb-f5ce-4957-9379-006ca33f3615 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lazy-loading 'fault' on Instance uuid 91383053-09e9-4294-86b1-ba106512b82f {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:08:06.581906 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-96f99beb-f5ce-4957-9379-006ca33f3615 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:06.590372 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-96f99beb-f5ce-4957-9379-006ca33f3615 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1351 microversion: 2.1 time: 0.100317 Jun 16 18:08:06.591233 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 146/287] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:06 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:06.976910 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-30c59767-1038-43b4-8d23-3d3d4acac2d5 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:06.977588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-30c59767-1038-43b4-8d23-3d3d4acac2d5 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:06.985467 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-30c59767-1038-43b4-8d23-3d3d4acac2d5 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:06.985847 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-30c59767-1038-43b4-8d23-3d3d4acac2d5 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:06.986619 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-30c59767-1038-43b4-8d23-3d3d4acac2d5 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:06.987701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-30c59767-1038-43b4-8d23-3d3d4acac2d5 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:07.074174 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-da55ed67-7448-4b6e-baf2-3d613027aa43 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:07.074857 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-da55ed67-7448-4b6e-baf2-3d613027aa43 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:07.083182 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-da55ed67-7448-4b6e-baf2-3d613027aa43 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:07.084012 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-da55ed67-7448-4b6e-baf2-3d613027aa43 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:07.084895 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-da55ed67-7448-4b6e-baf2-3d613027aa43 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:07.085439 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-da55ed67-7448-4b6e-baf2-3d613027aa43 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:07.128281 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-30c59767-1038-43b4-8d23-3d3d4acac2d5 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:07.136162 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-30c59767-1038-43b4-8d23-3d3d4acac2d5 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.163364 Jun 16 18:08:07.136923 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 142/288] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:06 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:07.230563 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-da55ed67-7448-4b6e-baf2-3d613027aa43 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:07.240122 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-da55ed67-7448-4b6e-baf2-3d613027aa43 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.169965 Jun 16 18:08:07.249101 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 147/289] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:07 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:07.607264 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c94d5733-7b5e-4e00-96d7-80ae27c3d2a2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:07.608065 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c94d5733-7b5e-4e00-96d7-80ae27c3d2a2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:07.615420 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c94d5733-7b5e-4e00-96d7-80ae27c3d2a2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:07.615950 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c94d5733-7b5e-4e00-96d7-80ae27c3d2a2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:07.616737 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c94d5733-7b5e-4e00-96d7-80ae27c3d2a2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:07.617157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c94d5733-7b5e-4e00-96d7-80ae27c3d2a2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:07.650594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c94d5733-7b5e-4e00-96d7-80ae27c3d2a2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:07.651019 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c94d5733-7b5e-4e00-96d7-80ae27c3d2a2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:07.656953 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-c94d5733-7b5e-4e00-96d7-80ae27c3d2a2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lazy-loading 'fault' on Instance uuid 91383053-09e9-4294-86b1-ba106512b82f {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:08:07.694991 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c94d5733-7b5e-4e00-96d7-80ae27c3d2a2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eac1fb288764b74baf30892237b3cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '285d8bae36f34e6a80a3982ebb097ea3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:07.702877 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c94d5733-7b5e-4e00-96d7-80ae27c3d2a2 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 200 len: 1351 microversion: 2.1 time: 0.099607 Jun 16 18:08:07.703452 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 143/290] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:07 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:08.153478 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f4baf6ee-f71f-4468-96e0-de4a1e95d309 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:08.154002 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f4baf6ee-f71f-4468-96e0-de4a1e95d309 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:08.161201 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f4baf6ee-f71f-4468-96e0-de4a1e95d309 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:08.161649 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f4baf6ee-f71f-4468-96e0-de4a1e95d309 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:08.162399 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f4baf6ee-f71f-4468-96e0-de4a1e95d309 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:08.162823 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f4baf6ee-f71f-4468-96e0-de4a1e95d309 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:08.264484 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4613ff11-404e-4593-8a25-207f327aaa15 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:08.265135 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4613ff11-404e-4593-8a25-207f327aaa15 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:08.272213 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4613ff11-404e-4593-8a25-207f327aaa15 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:08.272657 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4613ff11-404e-4593-8a25-207f327aaa15 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:08.273423 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4613ff11-404e-4593-8a25-207f327aaa15 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:08.273853 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4613ff11-404e-4593-8a25-207f327aaa15 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:08.298092 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f4baf6ee-f71f-4468-96e0-de4a1e95d309 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:08.305782 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f4baf6ee-f71f-4468-96e0-de4a1e95d309 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.156142 Jun 16 18:08:08.306524 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 148/291] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:08 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:08.417485 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4613ff11-404e-4593-8a25-207f327aaa15 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:08.427774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4613ff11-404e-4593-8a25-207f327aaa15 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1520 microversion: 2.1 time: 0.167145 Jun 16 18:08:08.428361 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 144/292] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:08 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:08.720281 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e876729f-e3b3-460f-a031-5b67fec59de6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:08.720885 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e876729f-e3b3-460f-a031-5b67fec59de6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:08.727595 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e876729f-e3b3-460f-a031-5b67fec59de6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:08.728039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e876729f-e3b3-460f-a031-5b67fec59de6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:08.729843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e876729f-e3b3-460f-a031-5b67fec59de6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:08.729843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e876729f-e3b3-460f-a031-5b67fec59de6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:08.732051 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=100 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:08.882038 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-e876729f-e3b3-460f-a031-5b67fec59de6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] HTTP exception thrown: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e876729f-e3b3-460f-a031-5b67fec59de6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Request method failure captured: Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f HTTP/1.1 Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3EyXRFZaZsDrwgBbxIerzvR5dxcssZghWAwdb5zUFKSBd7sKiMM8-2Dxb5MgLMH8Hur0QLjMDMAkXxRUqZYfQJ7yK7PWrH1MLUoR-rtyAoI0wDP2ulKLxnf3ZDeTjyU2dXcUZQuLArJgZ-Mmb8UbVmwIO465U80qfA00-u7YDc__bM Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 285d8bae36f34e6a80a3982ebb097ea3 Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-DeleteServersTestJSON-977952628 Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:08:08.886542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:08:08.888042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:08:08.888042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-DeleteServersTestJSON-977952628 Jun 16 18:08:08.888042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 285d8bae36f34e6a80a3982ebb097ea3 Jun 16 18:08:08.888042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-DeleteServersTestJSON-977952628 Jun 16 18:08:08.888042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-DeleteServersTestJSON-977952628-project Jun 16 18:08:08.888042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:08:08.888042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:08:08.888042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 9eac1fb288764b74baf30892237b3cdc Jun 16 18:08:08.888042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-DeleteServersTestJSON-977952628-project Jun 16 18:08:08.888042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:08:08.888042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:08.888042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '91383053-09e9-4294-86b1-ba106512b82f'} Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:08:08.888826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:08.890116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:08.891260 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e876729f-e3b3-460f-a031-5b67fec59de6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Returning 404 to user: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:08:08.891260 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e876729f-e3b3-460f-a031-5b67fec59de6 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 404 len: 111 microversion: 2.1 time: 0.171794 Jun 16 18:08:08.891260 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 149/293] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:08 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:08:08.996942 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ae6f6e2e-b690-4bc3-8000-06d6d8bd0105 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:08.997943 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ae6f6e2e-b690-4bc3-8000-06d6d8bd0105 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:09.004384 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ae6f6e2e-b690-4bc3-8000-06d6d8bd0105 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:09.004944 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ae6f6e2e-b690-4bc3-8000-06d6d8bd0105 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:09.010058 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ae6f6e2e-b690-4bc3-8000-06d6d8bd0105 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:09.010058 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ae6f6e2e-b690-4bc3-8000-06d6d8bd0105 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:09.019855 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-ae6f6e2e-b690-4bc3-8000-06d6d8bd0105 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] HTTP exception thrown: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ae6f6e2e-b690-4bc3-8000-06d6d8bd0105 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Request method failure captured: Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f/os-volume_attachments HTTP/1.1 Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3EyXRFZaZsDrwgBbxIerzvR5dxcssZghWAwdb5zUFKSBd7sKiMM8-2Dxb5MgLMH8Hur0QLjMDMAkXxRUqZYfQJ7yK7PWrH1MLUoR-rtyAoI0wDP2ulKLxnf3ZDeTjyU2dXcUZQuLArJgZ-Mmb8UbVmwIO465U80qfA00-u7YDc__bM Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 285d8bae36f34e6a80a3982ebb097ea3 Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-DeleteServersTestJSON-977952628 Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:08:09.023904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:08:09.025272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:08:09.025272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-DeleteServersTestJSON-977952628 Jun 16 18:08:09.025272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 285d8bae36f34e6a80a3982ebb097ea3 Jun 16 18:08:09.025272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-DeleteServersTestJSON-977952628 Jun 16 18:08:09.025272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-DeleteServersTestJSON-977952628-project Jun 16 18:08:09.025272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:08:09.025272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:08:09.025272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 9eac1fb288764b74baf30892237b3cdc Jun 16 18:08:09.025272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-DeleteServersTestJSON-977952628-project Jun 16 18:08:09.025272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:08:09.025272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:09.025272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'server_id': '91383053-09e9-4294-86b1-ba106512b82f'} Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:08:09.025958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:09.027124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:09.028475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ae6f6e2e-b690-4bc3-8000-06d6d8bd0105 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Returning 404 to user: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:08:09.028475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ae6f6e2e-b690-4bc3-8000-06d6d8bd0105 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032444 Jun 16 18:08:09.028475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 145/294] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:08:08 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:08:09.322593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-120ae15a-9322-4b2b-a0e1-9f2a9db28e4e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:09.323260 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-120ae15a-9322-4b2b-a0e1-9f2a9db28e4e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:09.326155 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:09.329626 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-120ae15a-9322-4b2b-a0e1-9f2a9db28e4e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:09.330072 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-120ae15a-9322-4b2b-a0e1-9f2a9db28e4e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:09.330825 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-120ae15a-9322-4b2b-a0e1-9f2a9db28e4e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:09.331253 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-120ae15a-9322-4b2b-a0e1-9f2a9db28e4e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:09.445733 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1dcb6f66-89ef-4f75-bd76-c3f8bb898b01 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:09.446346 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1dcb6f66-89ef-4f75-bd76-c3f8bb898b01 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:09.452997 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1dcb6f66-89ef-4f75-bd76-c3f8bb898b01 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:09.453635 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1dcb6f66-89ef-4f75-bd76-c3f8bb898b01 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:09.457095 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1dcb6f66-89ef-4f75-bd76-c3f8bb898b01 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:09.457095 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1dcb6f66-89ef-4f75-bd76-c3f8bb898b01 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:09.471569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-120ae15a-9322-4b2b-a0e1-9f2a9db28e4e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:09.479677 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-120ae15a-9322-4b2b-a0e1-9f2a9db28e4e tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1314 microversion: 2.1 time: 0.160958 Jun 16 18:08:09.480425 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 150/295] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:09 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:09.594058 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1dcb6f66-89ef-4f75-bd76-c3f8bb898b01 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:09.602170 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1dcb6f66-89ef-4f75-bd76-c3f8bb898b01 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1500 microversion: 2.1 time: 0.161139 Jun 16 18:08:09.602733 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 146/296] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:09 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1500 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:09.621053 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-696b37c5-bef2-4c52-852b-fe2164e95141 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:09.621658 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-696b37c5-bef2-4c52-852b-fe2164e95141 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:09.627595 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-696b37c5-bef2-4c52-852b-fe2164e95141 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:09.628040 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-696b37c5-bef2-4c52-852b-fe2164e95141 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:09.629437 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-696b37c5-bef2-4c52-852b-fe2164e95141 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:09.629963 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-696b37c5-bef2-4c52-852b-fe2164e95141 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:09.763681 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-696b37c5-bef2-4c52-852b-fe2164e95141 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:09.771263 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-696b37c5-bef2-4c52-852b-fe2164e95141 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1516 microversion: 2.1 time: 0.154125 Jun 16 18:08:09.771852 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 151/297] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:09 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:10.497999 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6730cffd-c37c-4076-b95a-46e429adfe7d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:10.498699 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6730cffd-c37c-4076-b95a-46e429adfe7d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:10.506571 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6730cffd-c37c-4076-b95a-46e429adfe7d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:10.507311 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6730cffd-c37c-4076-b95a-46e429adfe7d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:10.508118 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6730cffd-c37c-4076-b95a-46e429adfe7d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:10.508666 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6730cffd-c37c-4076-b95a-46e429adfe7d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:10.670400 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6730cffd-c37c-4076-b95a-46e429adfe7d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:10.678355 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6730cffd-c37c-4076-b95a-46e429adfe7d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1497 microversion: 2.1 time: 0.184651 Jun 16 18:08:10.678915 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 147/298] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:10 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:11.511276 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c2edcba1-f2ba-4623-84f7-5b85adc050ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:11.511915 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c2edcba1-f2ba-4623-84f7-5b85adc050ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:11.518955 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c2edcba1-f2ba-4623-84f7-5b85adc050ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:11.520012 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c2edcba1-f2ba-4623-84f7-5b85adc050ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:11.521075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c2edcba1-f2ba-4623-84f7-5b85adc050ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:11.521578 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c2edcba1-f2ba-4623-84f7-5b85adc050ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:11.538117 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-c2edcba1-f2ba-4623-84f7-5b85adc050ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] HTTP exception thrown: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c2edcba1-f2ba-4623-84f7-5b85adc050ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Request method failure captured: Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: DELETE /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f HTTP/1.1 Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3EyXRFZaZsDrwgBbxIerzvR5dxcssZghWAwdb5zUFKSBd7sKiMM8-2Dxb5MgLMH8Hur0QLjMDMAkXxRUqZYfQJ7yK7PWrH1MLUoR-rtyAoI0wDP2ulKLxnf3ZDeTjyU2dXcUZQuLArJgZ-Mmb8UbVmwIO465U80qfA00-u7YDc__bM Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 285d8bae36f34e6a80a3982ebb097ea3 Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-DeleteServersTestJSON-977952628 Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:08:11.539352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:08:11.540835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:08:11.540835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-DeleteServersTestJSON-977952628 Jun 16 18:08:11.540835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 285d8bae36f34e6a80a3982ebb097ea3 Jun 16 18:08:11.540835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-DeleteServersTestJSON-977952628 Jun 16 18:08:11.540835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-DeleteServersTestJSON-977952628-project Jun 16 18:08:11.540835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:08:11.540835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:08:11.540835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 9eac1fb288764b74baf30892237b3cdc Jun 16 18:08:11.540835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-DeleteServersTestJSON-977952628-project Jun 16 18:08:11.540835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:08:11.540835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:11.540835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '91383053-09e9-4294-86b1-ba106512b82f'} Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:08:11.544566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:11.546242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:11.547618 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c2edcba1-f2ba-4623-84f7-5b85adc050ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Returning 404 to user: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:08:11.547618 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c2edcba1-f2ba-4623-84f7-5b85adc050ec tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "DELETE /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 404 len: 111 microversion: 2.1 time: 0.034251 Jun 16 18:08:11.547618 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 152/299] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:08:11 2022] DELETE /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:08:11.551248 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-692dd0ef-ec9e-4550-a556-d940280f1ac0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:11.553227 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-692dd0ef-ec9e-4550-a556-d940280f1ac0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] [instance: 91383053-09e9-4294-86b1-ba106512b82f] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:11.559444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-692dd0ef-ec9e-4550-a556-d940280f1ac0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:11.559990 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-692dd0ef-ec9e-4550-a556-d940280f1ac0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:11.560633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-692dd0ef-ec9e-4550-a556-d940280f1ac0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:11.561059 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-692dd0ef-ec9e-4550-a556-d940280f1ac0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:11.574994 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-692dd0ef-ec9e-4550-a556-d940280f1ac0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] HTTP exception thrown: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-692dd0ef-ec9e-4550-a556-d940280f1ac0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Request method failure captured: Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f HTTP/1.1 Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3EyXRFZaZsDrwgBbxIerzvR5dxcssZghWAwdb5zUFKSBd7sKiMM8-2Dxb5MgLMH8Hur0QLjMDMAkXxRUqZYfQJ7yK7PWrH1MLUoR-rtyAoI0wDP2ulKLxnf3ZDeTjyU2dXcUZQuLArJgZ-Mmb8UbVmwIO465U80qfA00-u7YDc__bM Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 285d8bae36f34e6a80a3982ebb097ea3 Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-DeleteServersTestJSON-977952628 Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:08:11.577648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:08:11.579200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/285d8bae36f34e6a80a3982ebb097ea3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:08:11.579200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-DeleteServersTestJSON-977952628 Jun 16 18:08:11.579200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 285d8bae36f34e6a80a3982ebb097ea3 Jun 16 18:08:11.579200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-DeleteServersTestJSON-977952628 Jun 16 18:08:11.579200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-DeleteServersTestJSON-977952628-project Jun 16 18:08:11.579200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:08:11.579200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:08:11.579200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 9eac1fb288764b74baf30892237b3cdc Jun 16 18:08:11.579200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-DeleteServersTestJSON-977952628-project Jun 16 18:08:11.579200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:08:11.579200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:11.579200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '91383053-09e9-4294-86b1-ba106512b82f'} Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:08:11.580034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. Jun 16 18:08:11.581189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:11.582118 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-692dd0ef-ec9e-4550-a556-d940280f1ac0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] Returning 404 to user: Instance 91383053-09e9-4294-86b1-ba106512b82f could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:08:11.582118 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-692dd0ef-ec9e-4550-a556-d940280f1ac0 tempest-DeleteServersTestJSON-977952628 tempest-DeleteServersTestJSON-977952628-project] 10.222.0.58 "GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f" status: 404 len: 111 microversion: 2.1 time: 0.033818 Jun 16 18:08:11.582118 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 148/300] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:11 2022] GET /compute/v2.1/servers/91383053-09e9-4294-86b1-ba106512b82f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:08:12.733553 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-611b0dbd-c211-4404-9175-e5118ff91678 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:12.736001 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-611b0dbd-c211-4404-9175-e5118ff91678 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:12.751517 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-611b0dbd-c211-4404-9175-e5118ff91678 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:12.752145 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-611b0dbd-c211-4404-9175-e5118ff91678 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:12.752917 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-611b0dbd-c211-4404-9175-e5118ff91678 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:12.753343 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-611b0dbd-c211-4404-9175-e5118ff91678 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:12.786694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-08e46d55-fe88-4b91-b2b1-e97faa1351d0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:08:12.788631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-08e46d55-fe88-4b91-b2b1-e97faa1351d0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:12.797502 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-08e46d55-fe88-4b91-b2b1-e97faa1351d0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:12.798607 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-08e46d55-fe88-4b91-b2b1-e97faa1351d0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:12.799678 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-08e46d55-fe88-4b91-b2b1-e97faa1351d0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:12.800409 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-08e46d55-fe88-4b91-b2b1-e97faa1351d0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:12.826177 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-611b0dbd-c211-4404-9175-e5118ff91678 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Going to try to terminate instance {{(pid=118161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:08:12.832054 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-08e46d55-fe88-4b91-b2b1-e97faa1351d0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lazy-loading 'flavor' on Instance uuid 6d859d92-dab1-47f8-85ba-1e86413ceec9 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:08:13.172722 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-08e46d55-fe88-4b91-b2b1-e97faa1351d0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "POST /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9/action" status: 200 len: 32 microversion: 2.1 time: 0.390622 Jun 16 18:08:13.173412 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 149/301] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:08:12 2022] POST /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:08:13.190416 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-04592063-6589-45fe-a1f2-27b355d8ab94 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:13.191122 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-04592063-6589-45fe-a1f2-27b355d8ab94 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:13.199324 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-04592063-6589-45fe-a1f2-27b355d8ab94 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:13.200026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-04592063-6589-45fe-a1f2-27b355d8ab94 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:13.200705 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-04592063-6589-45fe-a1f2-27b355d8ab94 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:13.201093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-04592063-6589-45fe-a1f2-27b355d8ab94 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:13.203009 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-611b0dbd-c211-4404-9175-e5118ff91678 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 204 len: 0 microversion: 2.1 time: 0.472970 Jun 16 18:08:13.205191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 153/302] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:08:12 2022] DELETE /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:08:13.219594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-27367b82-9ebf-4653-9354-ee0b2ffc1c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:13.219878 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-27367b82-9ebf-4653-9354-ee0b2ffc1c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:13.226918 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27367b82-9ebf-4653-9354-ee0b2ffc1c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:13.227635 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27367b82-9ebf-4653-9354-ee0b2ffc1c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:13.228406 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27367b82-9ebf-4653-9354-ee0b2ffc1c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:13.228830 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27367b82-9ebf-4653-9354-ee0b2ffc1c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:13.461343 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-27367b82-9ebf-4653-9354-ee0b2ffc1c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:13.465027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-04592063-6589-45fe-a1f2-27b355d8ab94 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:13.475862 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-04592063-6589-45fe-a1f2-27b355d8ab94 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.289607 Jun 16 18:08:13.477034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 150/303] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:13 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:13.508516 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-27367b82-9ebf-4653-9354-ee0b2ffc1c8d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1503 microversion: 2.1 time: 0.293271 Jun 16 18:08:13.519093 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 154/304] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:13 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1503 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:14.495001 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-7100766f-d990-466b-9166-b542f6ff56c9 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:14.495755 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-7100766f-d990-466b-9166-b542f6ff56c9 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:14.502959 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7100766f-d990-466b-9166-b542f6ff56c9 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:14.503474 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7100766f-d990-466b-9166-b542f6ff56c9 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:14.504594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7100766f-d990-466b-9166-b542f6ff56c9 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:14.505213 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7100766f-d990-466b-9166-b542f6ff56c9 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:14.527017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1bd3456c-89d5-4cd1-83ca-7e7859129f1d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:14.527679 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1bd3456c-89d5-4cd1-83ca-7e7859129f1d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:14.535664 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1bd3456c-89d5-4cd1-83ca-7e7859129f1d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:14.536335 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1bd3456c-89d5-4cd1-83ca-7e7859129f1d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:14.537921 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1bd3456c-89d5-4cd1-83ca-7e7859129f1d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:14.538368 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1bd3456c-89d5-4cd1-83ca-7e7859129f1d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:14.809710 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7100766f-d990-466b-9166-b542f6ff56c9 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:14.823919 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-7100766f-d990-466b-9166-b542f6ff56c9 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.332793 Jun 16 18:08:14.830386 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 151/305] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:14 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:14.945276 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1bd3456c-89d5-4cd1-83ca-7e7859129f1d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:14.953340 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1bd3456c-89d5-4cd1-83ca-7e7859129f1d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1503 microversion: 2.1 time: 0.430921 Jun 16 18:08:14.954158 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 155/306] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:14 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1503 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:15.846953 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a887ab72-6123-4ac6-a629-ecee97c421f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:15.847690 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a887ab72-6123-4ac6-a629-ecee97c421f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:15.855837 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a887ab72-6123-4ac6-a629-ecee97c421f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:15.856387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a887ab72-6123-4ac6-a629-ecee97c421f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:15.857232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a887ab72-6123-4ac6-a629-ecee97c421f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:15.857909 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a887ab72-6123-4ac6-a629-ecee97c421f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:15.972578 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-688f095c-8885-42f9-a791-72c26a5c6513 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:15.980268 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-688f095c-8885-42f9-a791-72c26a5c6513 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:15.987780 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-688f095c-8885-42f9-a791-72c26a5c6513 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:15.988161 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-688f095c-8885-42f9-a791-72c26a5c6513 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:15.988927 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-688f095c-8885-42f9-a791-72c26a5c6513 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:15.989357 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-688f095c-8885-42f9-a791-72c26a5c6513 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:16.075483 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a887ab72-6123-4ac6-a629-ecee97c421f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:16.087635 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a887ab72-6123-4ac6-a629-ecee97c421f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.244415 Jun 16 18:08:16.088667 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 152/307] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:15 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:16.152310 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-688f095c-8885-42f9-a791-72c26a5c6513 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:16.161652 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-688f095c-8885-42f9-a791-72c26a5c6513 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1503 microversion: 2.1 time: 0.193631 Jun 16 18:08:16.163118 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 156/308] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:15 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:16.978230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-b777899c-080b-4f3d-aef2-0a42b6b2f3a2 req-5814760e-e546-42a1-a309-4f17c5e07f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdc610c-c258-4879-899c-f419cb005762", "name": "network-vif-deleted", "tag": "e91c2f6f-cfce-4c6e-88e2-ee89ed30902d"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:08:17.016155 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-b777899c-080b-4f3d-aef2-0a42b6b2f3a2 req-5814760e-e546-42a1-a309-4f17c5e07f80 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:17.016605 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-b777899c-080b-4f3d-aef2-0a42b6b2f3a2 req-5814760e-e546-42a1-a309-4f17c5e07f80 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:17.030008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-b777899c-080b-4f3d-aef2-0a42b6b2f3a2 req-5814760e-e546-42a1-a309-4f17c5e07f80 service nova] Creating event network-vif-deleted:e91c2f6f-cfce-4c6e-88e2-ee89ed30902d for instance 2bdc610c-c258-4879-899c-f419cb005762 on hv-cinder-83754 Jun 16 18:08:17.040908 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-b777899c-080b-4f3d-aef2-0a42b6b2f3a2 req-5814760e-e546-42a1-a309-4f17c5e07f80 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068835 Jun 16 18:08:17.040908 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 153/309] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:08:17.104760 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f9ffebf4-0cbf-47d6-8b1e-96136050283c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:17.105362 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f9ffebf4-0cbf-47d6-8b1e-96136050283c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:17.111331 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f9ffebf4-0cbf-47d6-8b1e-96136050283c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:17.111805 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f9ffebf4-0cbf-47d6-8b1e-96136050283c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:17.112557 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f9ffebf4-0cbf-47d6-8b1e-96136050283c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:17.112990 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f9ffebf4-0cbf-47d6-8b1e-96136050283c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:17.181408 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3162f13f-9486-4cf7-ab93-ef2b8ce522bb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:17.182103 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3162f13f-9486-4cf7-ab93-ef2b8ce522bb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:17.188660 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3162f13f-9486-4cf7-ab93-ef2b8ce522bb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:17.189109 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3162f13f-9486-4cf7-ab93-ef2b8ce522bb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:17.189868 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3162f13f-9486-4cf7-ab93-ef2b8ce522bb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:17.190294 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3162f13f-9486-4cf7-ab93-ef2b8ce522bb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:17.263320 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3162f13f-9486-4cf7-ab93-ef2b8ce522bb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:17.270887 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3162f13f-9486-4cf7-ab93-ef2b8ce522bb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1461 microversion: 2.1 time: 0.094820 Jun 16 18:08:17.271468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 154/310] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:17 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1461 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:17.284416 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f9ffebf4-0cbf-47d6-8b1e-96136050283c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:17.292639 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f9ffebf4-0cbf-47d6-8b1e-96136050283c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.191898 Jun 16 18:08:17.303729 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 157/311] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:17 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:18.288378 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6ba0c042-0b6f-4758-b0ef-5b11d819347d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:18.289318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6ba0c042-0b6f-4758-b0ef-5b11d819347d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:18.295784 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6ba0c042-0b6f-4758-b0ef-5b11d819347d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:18.296227 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6ba0c042-0b6f-4758-b0ef-5b11d819347d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:18.296988 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6ba0c042-0b6f-4758-b0ef-5b11d819347d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:18.297633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6ba0c042-0b6f-4758-b0ef-5b11d819347d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:18.317022 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:18.318393 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6a753b9b-9af1-4887-a37a-93b5401c6b62 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:18.319872 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6a753b9b-9af1-4887-a37a-93b5401c6b62 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:18.326122 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6a753b9b-9af1-4887-a37a-93b5401c6b62 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:18.326997 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6a753b9b-9af1-4887-a37a-93b5401c6b62 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:18.328497 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6a753b9b-9af1-4887-a37a-93b5401c6b62 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:18.329137 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6a753b9b-9af1-4887-a37a-93b5401c6b62 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:18.332612 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6ba0c042-0b6f-4758-b0ef-5b11d819347d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:18.333210 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6ba0c042-0b6f-4758-b0ef-5b11d819347d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:18.333645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-6ba0c042-0b6f-4758-b0ef-5b11d819347d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lazy-loading 'fault' on Instance uuid 2bdc610c-c258-4879-899c-f419cb005762 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:08:18.388225 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6ba0c042-0b6f-4758-b0ef-5b11d819347d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:18.398835 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6ba0c042-0b6f-4758-b0ef-5b11d819347d tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 200 len: 1304 microversion: 2.1 time: 0.114161 Jun 16 18:08:18.399477 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 155/312] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:18 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:18.509676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6a753b9b-9af1-4887-a37a-93b5401c6b62 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:18.517251 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6a753b9b-9af1-4887-a37a-93b5401c6b62 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.203189 Jun 16 18:08:18.517816 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 158/313] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:18 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:19.421434 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-55fbd304-8c0c-4dac-81b4-545a144c8863 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:19.422037 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-55fbd304-8c0c-4dac-81b4-545a144c8863 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 2bdc610c-c258-4879-899c-f419cb005762] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:19.429547 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-55fbd304-8c0c-4dac-81b4-545a144c8863 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:19.430114 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-55fbd304-8c0c-4dac-81b4-545a144c8863 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:19.430882 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-55fbd304-8c0c-4dac-81b4-545a144c8863 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:19.431318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-55fbd304-8c0c-4dac-81b4-545a144c8863 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:19.460687 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-55fbd304-8c0c-4dac-81b4-545a144c8863 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] HTTP exception thrown: Instance 2bdc610c-c258-4879-899c-f419cb005762 could not be found. Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-55fbd304-8c0c-4dac-81b4-545a144c8863 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Request method failure captured: Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 HTTP/1.1 Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3Foab6s469S3tCtE8CbT5Kaxwr3jBg8bvRfxw4ltuVuJeQhvqNJgWrgrY8KrgmrInwVjk81r9Xo3jkO4ClrCCdujq7vTP8dTc1mhJvxluHYSE4klcDsJjX7jOcpM2Xwu54XeylHadHeSGWtzF_0wpN9tHmSt3z0nxeRSAEqLRruZJY Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 7385d827292c44cf91ca0689dfc3753a Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-VolumesActionsTest-924271008 Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:08:19.462351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:08:19.463742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7385d827292c44cf91ca0689dfc3753a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7385d827292c44cf91ca0689dfc3753a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7385d827292c44cf91ca0689dfc3753a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7385d827292c44cf91ca0689dfc3753a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:08:19.463742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-VolumesActionsTest-924271008 Jun 16 18:08:19.463742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 7385d827292c44cf91ca0689dfc3753a Jun 16 18:08:19.463742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-VolumesActionsTest-924271008 Jun 16 18:08:19.463742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-VolumesActionsTest-924271008-project Jun 16 18:08:19.463742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:08:19.463742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:08:19.463742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 84114b0e2d6d4ea4b0b494d8b6e66a0e Jun 16 18:08:19.463742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-VolumesActionsTest-924271008-project Jun 16 18:08:19.463742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:08:19.463742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 2bdc610c-c258-4879-899c-f419cb005762 could not be found. Jun 16 18:08:19.463742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '2bdc610c-c258-4879-899c-f419cb005762'} Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bdc610c-c258-4879-899c-f419cb005762 could not be found. Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:08:19.464475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bdc610c-c258-4879-899c-f419cb005762 could not be found. Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bdc610c-c258-4879-899c-f419cb005762 could not be found. Jun 16 18:08:19.465616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:19.466857 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-55fbd304-8c0c-4dac-81b4-545a144c8863 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Returning 404 to user: Instance 2bdc610c-c258-4879-899c-f419cb005762 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:08:19.466857 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-55fbd304-8c0c-4dac-81b4-545a144c8863 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762" status: 404 len: 111 microversion: 2.1 time: 0.046785 Jun 16 18:08:19.466857 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 156/314] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:19 2022] GET /compute/v2.1/servers/2bdc610c-c258-4879-899c-f419cb005762 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:08:19.535657 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d798fdd1-46dd-4243-a6df-fe87971c9492 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:19.536325 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d798fdd1-46dd-4243-a6df-fe87971c9492 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:19.545075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d798fdd1-46dd-4243-a6df-fe87971c9492 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:19.549522 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d798fdd1-46dd-4243-a6df-fe87971c9492 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:19.549522 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d798fdd1-46dd-4243-a6df-fe87971c9492 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:19.549522 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d798fdd1-46dd-4243-a6df-fe87971c9492 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:19.598561 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-53865102", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "networks": [{"uuid": "2134625a-e5ca-440f-9971-f03f07198b47"}]}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:08:19.693014 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.network.neutron [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] validate_networks() for [('2134625a-e5ca-440f-9971-f03f07198b47', None, None, None, None, None)] {{(pid=118162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:08:19.754105 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d798fdd1-46dd-4243-a6df-fe87971c9492 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:19.759454 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d798fdd1-46dd-4243-a6df-fe87971c9492 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.229070 Jun 16 18:08:19.760772 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 159/315] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:19 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:20.123167 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Flavor limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:08:20.123697 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Image limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:08:20.124261 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Flavor pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:08:20.124677 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Image pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:08:20.125091 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:08:20.128099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=88 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:20.135422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:20.135814 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:20.136887 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:20.137333 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:20.167397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Getting quotas for project 7385d827292c44cf91ca0689dfc3753a. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:08:20.172656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Getting quotas for user 84114b0e2d6d4ea4b0b494d8b6e66a0e and project 7385d827292c44cf91ca0689dfc3753a. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:08:20.189308 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Going to run 1 instances... {{(pid=118162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:08:20.197859 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:08:20.370129 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-52e7fb68-49d3-4a2c-a171-5023353220b4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775345 Jun 16 18:08:20.370772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 157/316] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:08:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:08:20.380725 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-762b7009-2bf3-4f8c-b2a2-dfcd665cf935 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:20.382405 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-762b7009-2bf3-4f8c-b2a2-dfcd665cf935 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:20.435639 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-762b7009-2bf3-4f8c-b2a2-dfcd665cf935 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:20.445410 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-762b7009-2bf3-4f8c-b2a2-dfcd665cf935 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1212 microversion: 2.1 time: 0.068514 Jun 16 18:08:20.446180 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 160/317] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:20 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1212 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:20.779227 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-7cc690a7-e669-430f-8f93-13db627eba98 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:20.779866 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-7cc690a7-e669-430f-8f93-13db627eba98 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:20.788790 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7cc690a7-e669-430f-8f93-13db627eba98 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:20.789423 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7cc690a7-e669-430f-8f93-13db627eba98 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:20.792115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7cc690a7-e669-430f-8f93-13db627eba98 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:20.792115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7cc690a7-e669-430f-8f93-13db627eba98 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:20.924948 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7cc690a7-e669-430f-8f93-13db627eba98 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:20.936024 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-7cc690a7-e669-430f-8f93-13db627eba98 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.160928 Jun 16 18:08:20.946880 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 158/318] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:20 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:21.463078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d500a558-1fd2-4aae-8b93-6db1de0b3706 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:21.463708 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d500a558-1fd2-4aae-8b93-6db1de0b3706 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:21.469764 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d500a558-1fd2-4aae-8b93-6db1de0b3706 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:21.470205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d500a558-1fd2-4aae-8b93-6db1de0b3706 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:21.470960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d500a558-1fd2-4aae-8b93-6db1de0b3706 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:21.471424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d500a558-1fd2-4aae-8b93-6db1de0b3706 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:21.533516 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d500a558-1fd2-4aae-8b93-6db1de0b3706 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:21.541605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d500a558-1fd2-4aae-8b93-6db1de0b3706 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1216 microversion: 2.1 time: 0.083081 Jun 16 18:08:21.542166 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 161/319] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:21 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1216 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:21.958344 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b14055f1-6e8e-4770-81f3-1ca656b13b6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:21.959322 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b14055f1-6e8e-4770-81f3-1ca656b13b6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:21.967586 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b14055f1-6e8e-4770-81f3-1ca656b13b6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:21.968026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b14055f1-6e8e-4770-81f3-1ca656b13b6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:21.968794 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b14055f1-6e8e-4770-81f3-1ca656b13b6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:21.969218 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b14055f1-6e8e-4770-81f3-1ca656b13b6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:22.115808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b14055f1-6e8e-4770-81f3-1ca656b13b6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:22.124364 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b14055f1-6e8e-4770-81f3-1ca656b13b6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.173739 Jun 16 18:08:22.124937 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 159/320] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:21 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:22.558787 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-efb19451-da70-4cf8-b261-88b47ad2591c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:22.559506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-efb19451-da70-4cf8-b261-88b47ad2591c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:22.566215 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-efb19451-da70-4cf8-b261-88b47ad2591c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:22.566758 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-efb19451-da70-4cf8-b261-88b47ad2591c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:22.567584 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-efb19451-da70-4cf8-b261-88b47ad2591c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:22.568041 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-efb19451-da70-4cf8-b261-88b47ad2591c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:22.632699 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-efb19451-da70-4cf8-b261-88b47ad2591c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:22.640489 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-efb19451-da70-4cf8-b261-88b47ad2591c tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1264 microversion: 2.1 time: 0.086394 Jun 16 18:08:22.649079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 162/321] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:22 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1264 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:23.142769 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a3938efe-2d4d-42bf-81ba-df5dc1e9cf10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:23.143637 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a3938efe-2d4d-42bf-81ba-df5dc1e9cf10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:23.151837 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a3938efe-2d4d-42bf-81ba-df5dc1e9cf10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:23.152625 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a3938efe-2d4d-42bf-81ba-df5dc1e9cf10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:23.153630 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a3938efe-2d4d-42bf-81ba-df5dc1e9cf10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:23.154236 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a3938efe-2d4d-42bf-81ba-df5dc1e9cf10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:23.306298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a3938efe-2d4d-42bf-81ba-df5dc1e9cf10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:23.314835 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a3938efe-2d4d-42bf-81ba-df5dc1e9cf10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.176117 Jun 16 18:08:23.315492 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 160/322] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:23 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:23.664448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5222264b-85bd-4dd8-a1b9-341a6e8b5f99 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:23.665124 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5222264b-85bd-4dd8-a1b9-341a6e8b5f99 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:23.672448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5222264b-85bd-4dd8-a1b9-341a6e8b5f99 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:23.672879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5222264b-85bd-4dd8-a1b9-341a6e8b5f99 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:23.673625 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5222264b-85bd-4dd8-a1b9-341a6e8b5f99 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:23.674047 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5222264b-85bd-4dd8-a1b9-341a6e8b5f99 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:23.736490 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5222264b-85bd-4dd8-a1b9-341a6e8b5f99 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:23.744558 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5222264b-85bd-4dd8-a1b9-341a6e8b5f99 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1270 microversion: 2.1 time: 0.083401 Jun 16 18:08:23.745471 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 163/323] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:23 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:24.333218 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a7c275aa-fb20-440e-bcc0-d99d4114c660 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:24.333839 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a7c275aa-fb20-440e-bcc0-d99d4114c660 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:24.341101 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a7c275aa-fb20-440e-bcc0-d99d4114c660 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:24.341567 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a7c275aa-fb20-440e-bcc0-d99d4114c660 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:24.342448 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a7c275aa-fb20-440e-bcc0-d99d4114c660 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:24.342888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a7c275aa-fb20-440e-bcc0-d99d4114c660 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:24.475110 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a7c275aa-fb20-440e-bcc0-d99d4114c660 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:24.483615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a7c275aa-fb20-440e-bcc0-d99d4114c660 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.154513 Jun 16 18:08:24.484208 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 161/324] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:24 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:24.768087 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d4bfaedd-95e0-42ed-a3f7-55b6ca777737 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:24.768690 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d4bfaedd-95e0-42ed-a3f7-55b6ca777737 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:24.774743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d4bfaedd-95e0-42ed-a3f7-55b6ca777737 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:24.775180 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d4bfaedd-95e0-42ed-a3f7-55b6ca777737 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:24.777123 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d4bfaedd-95e0-42ed-a3f7-55b6ca777737 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:24.777552 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d4bfaedd-95e0-42ed-a3f7-55b6ca777737 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:24.912867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d4bfaedd-95e0-42ed-a3f7-55b6ca777737 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:24.920542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d4bfaedd-95e0-42ed-a3f7-55b6ca777737 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.156315 Jun 16 18:08:24.921229 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 164/325] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:24 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:25.216319 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-9302fa62-14a6-4081-8fe2-053244a28e08 req-bb1386e6-50be-476f-969b-6468673c9691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e7f6f18-8efb-45b5-88e1-259b5df6ba62", "tag": "659339da-6967-4ce5-8a6c-886a62e29094"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:08:25.230128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-9302fa62-14a6-4081-8fe2-053244a28e08 req-bb1386e6-50be-476f-969b-6468673c9691 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:25.230645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-9302fa62-14a6-4081-8fe2-053244a28e08 req-bb1386e6-50be-476f-969b-6468673c9691 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:25.247976 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-9302fa62-14a6-4081-8fe2-053244a28e08 req-bb1386e6-50be-476f-969b-6468673c9691 service nova] Creating event network-changed:659339da-6967-4ce5-8a6c-886a62e29094 for instance 7e7f6f18-8efb-45b5-88e1-259b5df6ba62 on hv-cinder-83754 Jun 16 18:08:25.258243 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-9302fa62-14a6-4081-8fe2-053244a28e08 req-bb1386e6-50be-476f-969b-6468673c9691 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052419 Jun 16 18:08:25.267502 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 162/326] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:08:25.505211 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ea93b6f3-9841-4c4d-8585-6218badf2423 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:25.507117 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ea93b6f3-9841-4c4d-8585-6218badf2423 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:25.515554 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ea93b6f3-9841-4c4d-8585-6218badf2423 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:25.516051 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ea93b6f3-9841-4c4d-8585-6218badf2423 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:25.516847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ea93b6f3-9841-4c4d-8585-6218badf2423 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:25.517283 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ea93b6f3-9841-4c4d-8585-6218badf2423 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:25.662661 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ea93b6f3-9841-4c4d-8585-6218badf2423 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:25.671395 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ea93b6f3-9841-4c4d-8585-6218badf2423 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.170230 Jun 16 18:08:25.671977 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 165/327] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:25 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:25.937816 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-054f5ad3-1269-41ca-890a-edf9d044c751 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:25.938510 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-054f5ad3-1269-41ca-890a-edf9d044c751 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:25.944783 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-054f5ad3-1269-41ca-890a-edf9d044c751 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:25.945269 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-054f5ad3-1269-41ca-890a-edf9d044c751 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:25.945978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-054f5ad3-1269-41ca-890a-edf9d044c751 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:25.946404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-054f5ad3-1269-41ca-890a-edf9d044c751 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:26.115426 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-054f5ad3-1269-41ca-890a-edf9d044c751 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:26.123167 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-054f5ad3-1269-41ca-890a-edf9d044c751 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.190032 Jun 16 18:08:26.123761 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 163/328] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:25 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:26.688896 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ccf27d1d-8de9-4f2d-a141-cdfa91cc18f8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:26.689516 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ccf27d1d-8de9-4f2d-a141-cdfa91cc18f8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:26.695594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ccf27d1d-8de9-4f2d-a141-cdfa91cc18f8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:26.698486 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ccf27d1d-8de9-4f2d-a141-cdfa91cc18f8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:26.698486 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ccf27d1d-8de9-4f2d-a141-cdfa91cc18f8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:26.698486 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ccf27d1d-8de9-4f2d-a141-cdfa91cc18f8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:26.713030 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:26.833136 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ccf27d1d-8de9-4f2d-a141-cdfa91cc18f8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:26.841774 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ccf27d1d-8de9-4f2d-a141-cdfa91cc18f8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.155907 Jun 16 18:08:26.843007 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 166/329] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:26 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:27.141166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-daafedba-79bc-44ff-af4b-c2b791b86654 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:27.141678 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-daafedba-79bc-44ff-af4b-c2b791b86654 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:27.148183 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-daafedba-79bc-44ff-af4b-c2b791b86654 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:27.148629 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-daafedba-79bc-44ff-af4b-c2b791b86654 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:27.149386 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-daafedba-79bc-44ff-af4b-c2b791b86654 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:27.149816 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-daafedba-79bc-44ff-af4b-c2b791b86654 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:27.281426 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-daafedba-79bc-44ff-af4b-c2b791b86654 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:27.288930 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-daafedba-79bc-44ff-af4b-c2b791b86654 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.151949 Jun 16 18:08:27.289487 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 164/330] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:27 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:27.858629 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2d8201e5-fa3d-4740-9d5c-5d6f2a0aaa00 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:27.859346 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2d8201e5-fa3d-4740-9d5c-5d6f2a0aaa00 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:27.865937 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2d8201e5-fa3d-4740-9d5c-5d6f2a0aaa00 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:27.866382 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2d8201e5-fa3d-4740-9d5c-5d6f2a0aaa00 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:27.867129 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2d8201e5-fa3d-4740-9d5c-5d6f2a0aaa00 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:27.867595 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2d8201e5-fa3d-4740-9d5c-5d6f2a0aaa00 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:28.018226 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2d8201e5-fa3d-4740-9d5c-5d6f2a0aaa00 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:28.025869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2d8201e5-fa3d-4740-9d5c-5d6f2a0aaa00 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.171729 Jun 16 18:08:28.026476 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 167/331] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:27 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:28.306160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-69541a3d-7ff4-4030-99a5-d0c646d6424a tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:28.306887 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-69541a3d-7ff4-4030-99a5-d0c646d6424a tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:28.314158 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-69541a3d-7ff4-4030-99a5-d0c646d6424a tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:28.314614 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-69541a3d-7ff4-4030-99a5-d0c646d6424a tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:28.315474 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-69541a3d-7ff4-4030-99a5-d0c646d6424a tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:28.315915 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-69541a3d-7ff4-4030-99a5-d0c646d6424a tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:28.483599 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-69541a3d-7ff4-4030-99a5-d0c646d6424a tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:28.491039 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-69541a3d-7ff4-4030-99a5-d0c646d6424a tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.189040 Jun 16 18:08:28.491655 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 165/332] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:28 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:29.043292 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1e07e63d-7f24-408f-9923-9f1753270272 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:29.043838 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1e07e63d-7f24-408f-9923-9f1753270272 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:29.049887 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1e07e63d-7f24-408f-9923-9f1753270272 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:29.050361 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1e07e63d-7f24-408f-9923-9f1753270272 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:29.051117 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1e07e63d-7f24-408f-9923-9f1753270272 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:29.051588 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1e07e63d-7f24-408f-9923-9f1753270272 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:29.181615 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1e07e63d-7f24-408f-9923-9f1753270272 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:29.189472 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1e07e63d-7f24-408f-9923-9f1753270272 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.150262 Jun 16 18:08:29.190013 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 168/333] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:29 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:29.507848 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2126d031-9577-4563-b123-f06684cd78e4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:29.508461 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2126d031-9577-4563-b123-f06684cd78e4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:29.515944 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2126d031-9577-4563-b123-f06684cd78e4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:29.516398 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2126d031-9577-4563-b123-f06684cd78e4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:29.517193 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2126d031-9577-4563-b123-f06684cd78e4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:29.517628 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2126d031-9577-4563-b123-f06684cd78e4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:29.644920 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2126d031-9577-4563-b123-f06684cd78e4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:29.652389 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2126d031-9577-4563-b123-f06684cd78e4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.148309 Jun 16 18:08:29.652956 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 166/334] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:29 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:30.206067 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5c10ffe5-4c6d-441c-98ed-b09a41382e6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:30.210827 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5c10ffe5-4c6d-441c-98ed-b09a41382e6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:30.213002 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5c10ffe5-4c6d-441c-98ed-b09a41382e6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:30.213449 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5c10ffe5-4c6d-441c-98ed-b09a41382e6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:30.214766 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5c10ffe5-4c6d-441c-98ed-b09a41382e6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:30.215494 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5c10ffe5-4c6d-441c-98ed-b09a41382e6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:30.347593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5c10ffe5-4c6d-441c-98ed-b09a41382e6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:30.355184 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5c10ffe5-4c6d-441c-98ed-b09a41382e6b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.152807 Jun 16 18:08:30.355845 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 169/335] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:30 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:30.668886 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-07f970a9-1609-41f2-9fb0-a5ddf69490c9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:30.669494 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-07f970a9-1609-41f2-9fb0-a5ddf69490c9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:30.671451 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:30.672243 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=6 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:30.677323 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-07f970a9-1609-41f2-9fb0-a5ddf69490c9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:30.677770 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-07f970a9-1609-41f2-9fb0-a5ddf69490c9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:30.678537 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-07f970a9-1609-41f2-9fb0-a5ddf69490c9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:30.680251 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-07f970a9-1609-41f2-9fb0-a5ddf69490c9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:30.809627 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-07f970a9-1609-41f2-9fb0-a5ddf69490c9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:30.817067 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-07f970a9-1609-41f2-9fb0-a5ddf69490c9 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.152082 Jun 16 18:08:30.817632 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 167/336] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:30 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:31.373123 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-36453de3-707b-4c3a-9b57-30755349b4a1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:31.373722 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-36453de3-707b-4c3a-9b57-30755349b4a1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:31.375570 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:31.380402 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-36453de3-707b-4c3a-9b57-30755349b4a1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:31.386260 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-36453de3-707b-4c3a-9b57-30755349b4a1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:31.386260 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-36453de3-707b-4c3a-9b57-30755349b4a1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:31.386260 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-36453de3-707b-4c3a-9b57-30755349b4a1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:31.514312 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-36453de3-707b-4c3a-9b57-30755349b4a1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:31.521619 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-36453de3-707b-4c3a-9b57-30755349b4a1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.153207 Jun 16 18:08:31.522169 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 170/337] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:31 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:31.834639 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6f544ed8-1286-4afa-9e65-c70256ce8bb8 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:31.835164 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6f544ed8-1286-4afa-9e65-c70256ce8bb8 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:31.841937 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6f544ed8-1286-4afa-9e65-c70256ce8bb8 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:31.842388 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6f544ed8-1286-4afa-9e65-c70256ce8bb8 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:31.843157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6f544ed8-1286-4afa-9e65-c70256ce8bb8 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:31.843664 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6f544ed8-1286-4afa-9e65-c70256ce8bb8 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:31.972558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6f544ed8-1286-4afa-9e65-c70256ce8bb8 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:31.981121 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6f544ed8-1286-4afa-9e65-c70256ce8bb8 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.149715 Jun 16 18:08:31.981718 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 168/338] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:31 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:32.538907 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d9d3a9ec-9249-4fac-a8e7-281514e6fac4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:32.539441 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d9d3a9ec-9249-4fac-a8e7-281514e6fac4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:32.546528 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d9d3a9ec-9249-4fac-a8e7-281514e6fac4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:32.546967 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d9d3a9ec-9249-4fac-a8e7-281514e6fac4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:32.547736 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d9d3a9ec-9249-4fac-a8e7-281514e6fac4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:32.548160 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d9d3a9ec-9249-4fac-a8e7-281514e6fac4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:32.683490 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d9d3a9ec-9249-4fac-a8e7-281514e6fac4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:32.691103 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d9d3a9ec-9249-4fac-a8e7-281514e6fac4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.156070 Jun 16 18:08:32.691697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 171/339] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:32 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:32.999047 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-777cef13-91da-4aeb-86fb-968bfe01e903 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:32.999696 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-777cef13-91da-4aeb-86fb-968bfe01e903 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:33.006229 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-777cef13-91da-4aeb-86fb-968bfe01e903 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:33.006666 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-777cef13-91da-4aeb-86fb-968bfe01e903 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:33.007571 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-777cef13-91da-4aeb-86fb-968bfe01e903 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:33.007997 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-777cef13-91da-4aeb-86fb-968bfe01e903 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:33.143560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-777cef13-91da-4aeb-86fb-968bfe01e903 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:33.151045 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-777cef13-91da-4aeb-86fb-968bfe01e903 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.157277 Jun 16 18:08:33.151629 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 169/340] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:32 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:33.708506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-20c8e8ff-89bd-40f6-ac2c-1e92146bd39c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:33.709142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-20c8e8ff-89bd-40f6-ac2c-1e92146bd39c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:33.715109 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-20c8e8ff-89bd-40f6-ac2c-1e92146bd39c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:33.715588 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-20c8e8ff-89bd-40f6-ac2c-1e92146bd39c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:33.717129 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-20c8e8ff-89bd-40f6-ac2c-1e92146bd39c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:33.717618 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-20c8e8ff-89bd-40f6-ac2c-1e92146bd39c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:33.845601 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-20c8e8ff-89bd-40f6-ac2c-1e92146bd39c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:33.853053 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-20c8e8ff-89bd-40f6-ac2c-1e92146bd39c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.148383 Jun 16 18:08:33.853611 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 172/341] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:33 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:34.167800 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ea378374-4b3a-495f-a561-215033a67a06 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:34.168437 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ea378374-4b3a-495f-a561-215033a67a06 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:34.174740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ea378374-4b3a-495f-a561-215033a67a06 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:34.175180 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ea378374-4b3a-495f-a561-215033a67a06 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:34.175971 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ea378374-4b3a-495f-a561-215033a67a06 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:34.176402 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ea378374-4b3a-495f-a561-215033a67a06 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:34.309307 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ea378374-4b3a-495f-a561-215033a67a06 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:34.318321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ea378374-4b3a-495f-a561-215033a67a06 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.154569 Jun 16 18:08:34.318899 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 170/342] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:34 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:34.870354 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-04f762ed-b061-4434-a90e-db905ae556b4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:34.870872 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-04f762ed-b061-4434-a90e-db905ae556b4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:34.878028 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-04f762ed-b061-4434-a90e-db905ae556b4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:34.878475 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-04f762ed-b061-4434-a90e-db905ae556b4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:34.883036 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-04f762ed-b061-4434-a90e-db905ae556b4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:34.883036 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-04f762ed-b061-4434-a90e-db905ae556b4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:35.008714 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-04f762ed-b061-4434-a90e-db905ae556b4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:35.017614 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-04f762ed-b061-4434-a90e-db905ae556b4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.151175 Jun 16 18:08:35.018187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 173/343] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:34 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:35.335346 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9b405d00-cc06-4a6a-a23a-330870b6a0c4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:35.336085 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9b405d00-cc06-4a6a-a23a-330870b6a0c4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:35.344578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9b405d00-cc06-4a6a-a23a-330870b6a0c4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:35.344726 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9b405d00-cc06-4a6a-a23a-330870b6a0c4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:35.345708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9b405d00-cc06-4a6a-a23a-330870b6a0c4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:35.346152 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9b405d00-cc06-4a6a-a23a-330870b6a0c4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:35.482065 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9b405d00-cc06-4a6a-a23a-330870b6a0c4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:35.490554 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9b405d00-cc06-4a6a-a23a-330870b6a0c4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.158931 Jun 16 18:08:35.491281 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 171/344] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:35 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:36.036960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-93524643-b73d-4693-96e8-0d09918be548 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:36.037566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-93524643-b73d-4693-96e8-0d09918be548 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:36.043631 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-93524643-b73d-4693-96e8-0d09918be548 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:36.044080 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-93524643-b73d-4693-96e8-0d09918be548 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:36.044834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-93524643-b73d-4693-96e8-0d09918be548 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:36.045295 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-93524643-b73d-4693-96e8-0d09918be548 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:36.180980 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-93524643-b73d-4693-96e8-0d09918be548 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:36.188750 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-93524643-b73d-4693-96e8-0d09918be548 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.155944 Jun 16 18:08:36.189314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 174/345] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:36 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:36.507460 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-81364c98-3d1f-42e5-9505-da5371b03559 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:36.508087 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-81364c98-3d1f-42e5-9505-da5371b03559 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:36.515127 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-81364c98-3d1f-42e5-9505-da5371b03559 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:36.516274 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-81364c98-3d1f-42e5-9505-da5371b03559 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:36.517038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-81364c98-3d1f-42e5-9505-da5371b03559 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:36.517494 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-81364c98-3d1f-42e5-9505-da5371b03559 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:36.646551 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-81364c98-3d1f-42e5-9505-da5371b03559 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:36.654018 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-81364c98-3d1f-42e5-9505-da5371b03559 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.150476 Jun 16 18:08:36.658661 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 172/346] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:36 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:37.205782 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5ceaaf07-98b7-4326-bbab-11d12a014132 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:37.207955 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5ceaaf07-98b7-4326-bbab-11d12a014132 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:37.212353 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5ceaaf07-98b7-4326-bbab-11d12a014132 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:37.212784 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5ceaaf07-98b7-4326-bbab-11d12a014132 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:37.213534 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5ceaaf07-98b7-4326-bbab-11d12a014132 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:37.213955 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5ceaaf07-98b7-4326-bbab-11d12a014132 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:37.355848 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5ceaaf07-98b7-4326-bbab-11d12a014132 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:37.364299 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5ceaaf07-98b7-4326-bbab-11d12a014132 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.162293 Jun 16 18:08:37.364875 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 175/347] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:37 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:37.672097 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-efd92dad-87e8-4e1d-832a-c197a60b8576 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:37.674543 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-efd92dad-87e8-4e1d-832a-c197a60b8576 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:37.688210 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-efd92dad-87e8-4e1d-832a-c197a60b8576 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:37.688871 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-efd92dad-87e8-4e1d-832a-c197a60b8576 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:37.689644 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-efd92dad-87e8-4e1d-832a-c197a60b8576 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:37.690076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-efd92dad-87e8-4e1d-832a-c197a60b8576 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:37.823099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-efd92dad-87e8-4e1d-832a-c197a60b8576 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:37.826488 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=100 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:37.831071 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-efd92dad-87e8-4e1d-832a-c197a60b8576 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.164148 Jun 16 18:08:37.831666 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 173/348] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:37 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:38.381482 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-53b2a3c8-6b80-4248-8cb9-f1ec4ed8649d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:38.382197 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-53b2a3c8-6b80-4248-8cb9-f1ec4ed8649d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:38.388719 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-53b2a3c8-6b80-4248-8cb9-f1ec4ed8649d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:38.389160 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-53b2a3c8-6b80-4248-8cb9-f1ec4ed8649d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:38.390246 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-53b2a3c8-6b80-4248-8cb9-f1ec4ed8649d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:38.390677 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-53b2a3c8-6b80-4248-8cb9-f1ec4ed8649d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:38.525210 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-53b2a3c8-6b80-4248-8cb9-f1ec4ed8649d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:38.533424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-53b2a3c8-6b80-4248-8cb9-f1ec4ed8649d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.155930 Jun 16 18:08:38.533994 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 176/349] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:38 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:38.848838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-85fc8da4-e7e8-4474-b9a7-9be2cd431a05 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:38.849462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-85fc8da4-e7e8-4474-b9a7-9be2cd431a05 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:38.856681 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-85fc8da4-e7e8-4474-b9a7-9be2cd431a05 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:38.857153 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-85fc8da4-e7e8-4474-b9a7-9be2cd431a05 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:38.858101 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-85fc8da4-e7e8-4474-b9a7-9be2cd431a05 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:38.859175 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-85fc8da4-e7e8-4474-b9a7-9be2cd431a05 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:39.011981 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-85fc8da4-e7e8-4474-b9a7-9be2cd431a05 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:39.021574 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-85fc8da4-e7e8-4474-b9a7-9be2cd431a05 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.178156 Jun 16 18:08:39.022141 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 174/350] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:38 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:39.550488 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e13e6011-2e41-4bb4-af64-dd63c694017a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:39.551224 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e13e6011-2e41-4bb4-af64-dd63c694017a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:39.557604 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e13e6011-2e41-4bb4-af64-dd63c694017a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:39.558062 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e13e6011-2e41-4bb4-af64-dd63c694017a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:39.558831 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e13e6011-2e41-4bb4-af64-dd63c694017a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:39.559307 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e13e6011-2e41-4bb4-af64-dd63c694017a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:39.699015 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e13e6011-2e41-4bb4-af64-dd63c694017a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:39.715574 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e13e6011-2e41-4bb4-af64-dd63c694017a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.169391 Jun 16 18:08:39.716146 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 177/351] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:39 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:39.809161 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-54dddffb-e973-4f94-b45f-8a0504e730f9 req-cced4e08-dbfe-4dd2-aa4e-6ff4c0eca207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7f6f18-8efb-45b5-88e1-259b5df6ba62", "name": "network-vif-plugged", "status": "completed", "tag": "659339da-6967-4ce5-8a6c-886a62e29094"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:08:39.818257 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-54dddffb-e973-4f94-b45f-8a0504e730f9 req-cced4e08-dbfe-4dd2-aa4e-6ff4c0eca207 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:39.818716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-54dddffb-e973-4f94-b45f-8a0504e730f9 req-cced4e08-dbfe-4dd2-aa4e-6ff4c0eca207 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:39.829963 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-54dddffb-e973-4f94-b45f-8a0504e730f9 req-cced4e08-dbfe-4dd2-aa4e-6ff4c0eca207 service nova] Creating event network-vif-plugged:659339da-6967-4ce5-8a6c-886a62e29094 for instance 7e7f6f18-8efb-45b5-88e1-259b5df6ba62 on hv-cinder-83754 Jun 16 18:08:39.835004 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-54dddffb-e973-4f94-b45f-8a0504e730f9 req-cced4e08-dbfe-4dd2-aa4e-6ff4c0eca207 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029602 Jun 16 18:08:39.835615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 175/352] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:08:40.039561 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-07097413-3e25-461a-81c7-c9afba549ef4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:40.040449 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-07097413-3e25-461a-81c7-c9afba549ef4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:40.048428 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07097413-3e25-461a-81c7-c9afba549ef4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:40.052851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07097413-3e25-461a-81c7-c9afba549ef4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:40.052851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07097413-3e25-461a-81c7-c9afba549ef4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:40.052851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07097413-3e25-461a-81c7-c9afba549ef4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:40.211634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-07097413-3e25-461a-81c7-c9afba549ef4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:40.230800 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-07097413-3e25-461a-81c7-c9afba549ef4 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.194946 Jun 16 18:08:40.231726 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 178/353] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:40 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:40.733657 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9d6f7d4f-82d6-4407-babc-ee000020f479 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:40.734360 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9d6f7d4f-82d6-4407-babc-ee000020f479 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:40.741300 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9d6f7d4f-82d6-4407-babc-ee000020f479 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:40.741869 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9d6f7d4f-82d6-4407-babc-ee000020f479 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:40.742826 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9d6f7d4f-82d6-4407-babc-ee000020f479 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:40.743195 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9d6f7d4f-82d6-4407-babc-ee000020f479 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:40.885326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9d6f7d4f-82d6-4407-babc-ee000020f479 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:40.894189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9d6f7d4f-82d6-4407-babc-ee000020f479 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.165160 Jun 16 18:08:40.894753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 176/354] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:40 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:41.247975 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-078b818a-0dd0-4b35-b1e4-3f0be70596bd tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:41.248814 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-078b818a-0dd0-4b35-b1e4-3f0be70596bd tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:41.256029 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-078b818a-0dd0-4b35-b1e4-3f0be70596bd tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:41.256474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-078b818a-0dd0-4b35-b1e4-3f0be70596bd tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:41.257247 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-078b818a-0dd0-4b35-b1e4-3f0be70596bd tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:41.257680 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-078b818a-0dd0-4b35-b1e4-3f0be70596bd tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:41.411227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-078b818a-0dd0-4b35-b1e4-3f0be70596bd tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:41.418624 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-078b818a-0dd0-4b35-b1e4-3f0be70596bd tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.174494 Jun 16 18:08:41.419465 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 179/355] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:41 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:41.911735 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2e70c3fa-cfeb-46a3-9d75-5a820133b217 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:41.912264 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2e70c3fa-cfeb-46a3-9d75-5a820133b217 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:41.918906 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2e70c3fa-cfeb-46a3-9d75-5a820133b217 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:41.919426 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2e70c3fa-cfeb-46a3-9d75-5a820133b217 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:41.920197 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2e70c3fa-cfeb-46a3-9d75-5a820133b217 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:41.920641 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2e70c3fa-cfeb-46a3-9d75-5a820133b217 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:42.051878 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2e70c3fa-cfeb-46a3-9d75-5a820133b217 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:42.060250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2e70c3fa-cfeb-46a3-9d75-5a820133b217 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.153016 Jun 16 18:08:42.060655 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 177/356] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:41 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:42.435889 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-36c2fdd9-a321-4cd0-9add-89f587440ef1 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:42.436496 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-36c2fdd9-a321-4cd0-9add-89f587440ef1 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:42.438341 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:42.443131 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-36c2fdd9-a321-4cd0-9add-89f587440ef1 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:42.443611 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-36c2fdd9-a321-4cd0-9add-89f587440ef1 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:42.444379 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-36c2fdd9-a321-4cd0-9add-89f587440ef1 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:42.444804 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-36c2fdd9-a321-4cd0-9add-89f587440ef1 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:42.582034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-36c2fdd9-a321-4cd0-9add-89f587440ef1 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:42.589722 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-36c2fdd9-a321-4cd0-9add-89f587440ef1 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.157713 Jun 16 18:08:42.590284 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 180/357] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:42 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:43.076870 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6b871e7e-191c-41be-bcd2-e8a7f129e440 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:43.077575 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6b871e7e-191c-41be-bcd2-e8a7f129e440 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:43.084964 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6b871e7e-191c-41be-bcd2-e8a7f129e440 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:43.085622 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6b871e7e-191c-41be-bcd2-e8a7f129e440 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:43.086397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6b871e7e-191c-41be-bcd2-e8a7f129e440 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:43.086837 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6b871e7e-191c-41be-bcd2-e8a7f129e440 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:43.217018 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6b871e7e-191c-41be-bcd2-e8a7f129e440 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:43.224947 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6b871e7e-191c-41be-bcd2-e8a7f129e440 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.151848 Jun 16 18:08:43.225509 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 178/358] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:43 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:43.607113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5d1d7d7a-ce71-4ce3-94a9-641b4594c7c0 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:43.607759 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5d1d7d7a-ce71-4ce3-94a9-641b4594c7c0 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:43.613993 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d1d7d7a-ce71-4ce3-94a9-641b4594c7c0 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:43.614983 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d1d7d7a-ce71-4ce3-94a9-641b4594c7c0 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:43.615781 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d1d7d7a-ce71-4ce3-94a9-641b4594c7c0 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:43.616213 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d1d7d7a-ce71-4ce3-94a9-641b4594c7c0 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:43.745234 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5d1d7d7a-ce71-4ce3-94a9-641b4594c7c0 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:43.753555 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5d1d7d7a-ce71-4ce3-94a9-641b4594c7c0 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.150216 Jun 16 18:08:43.754209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 181/359] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:43 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:44.242200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-622591e9-a683-458a-9af6-205995b4f94a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:44.242816 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-622591e9-a683-458a-9af6-205995b4f94a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:44.249350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-622591e9-a683-458a-9af6-205995b4f94a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:44.249791 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-622591e9-a683-458a-9af6-205995b4f94a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:44.250749 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-622591e9-a683-458a-9af6-205995b4f94a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:44.251180 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-622591e9-a683-458a-9af6-205995b4f94a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:44.385942 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-622591e9-a683-458a-9af6-205995b4f94a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:44.393808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-622591e9-a683-458a-9af6-205995b4f94a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.155392 Jun 16 18:08:44.397868 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 179/360] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:44 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:44.771130 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-91c53cbc-504d-4632-bafc-07c18ffa7467 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:44.771794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-91c53cbc-504d-4632-bafc-07c18ffa7467 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:44.777794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-91c53cbc-504d-4632-bafc-07c18ffa7467 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:44.778237 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-91c53cbc-504d-4632-bafc-07c18ffa7467 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:44.778985 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-91c53cbc-504d-4632-bafc-07c18ffa7467 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:44.779436 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-91c53cbc-504d-4632-bafc-07c18ffa7467 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:44.909686 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-91c53cbc-504d-4632-bafc-07c18ffa7467 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:44.917039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-91c53cbc-504d-4632-bafc-07c18ffa7467 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.150862 Jun 16 18:08:44.917588 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 182/361] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:44 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:45.411839 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1e32c436-908c-43da-ab9d-e3ea787ee69d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:45.412437 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1e32c436-908c-43da-ab9d-e3ea787ee69d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:45.418836 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1e32c436-908c-43da-ab9d-e3ea787ee69d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:45.419272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1e32c436-908c-43da-ab9d-e3ea787ee69d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:45.420079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1e32c436-908c-43da-ab9d-e3ea787ee69d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:45.420504 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1e32c436-908c-43da-ab9d-e3ea787ee69d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:45.561762 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1e32c436-908c-43da-ab9d-e3ea787ee69d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:45.570949 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1e32c436-908c-43da-ab9d-e3ea787ee69d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.163600 Jun 16 18:08:45.571528 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 180/362] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:45 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:45.933677 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-cc3fbce1-693f-437a-9e8c-85ca47b70199 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:45.934288 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-cc3fbce1-693f-437a-9e8c-85ca47b70199 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:45.940697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cc3fbce1-693f-437a-9e8c-85ca47b70199 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:45.941143 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cc3fbce1-693f-437a-9e8c-85ca47b70199 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:45.941905 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cc3fbce1-693f-437a-9e8c-85ca47b70199 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:45.942339 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cc3fbce1-693f-437a-9e8c-85ca47b70199 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:45.944966 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=100 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:46.071058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-cc3fbce1-693f-437a-9e8c-85ca47b70199 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:46.078592 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-cc3fbce1-693f-437a-9e8c-85ca47b70199 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.148799 Jun 16 18:08:46.079145 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 183/363] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:45 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:46.587793 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dc533b5b-c54b-48d9-8370-cf754bebd2f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:46.588443 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-dc533b5b-c54b-48d9-8370-cf754bebd2f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:46.595283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc533b5b-c54b-48d9-8370-cf754bebd2f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:46.595768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc533b5b-c54b-48d9-8370-cf754bebd2f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:46.597315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc533b5b-c54b-48d9-8370-cf754bebd2f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:46.597938 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc533b5b-c54b-48d9-8370-cf754bebd2f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:46.726582 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dc533b5b-c54b-48d9-8370-cf754bebd2f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:46.734049 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-dc533b5b-c54b-48d9-8370-cf754bebd2f4 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.150125 Jun 16 18:08:46.734602 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 181/364] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:46 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:47.095802 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-00a1d133-a2a2-40f2-8c14-5452d00b0fbb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:47.096943 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-00a1d133-a2a2-40f2-8c14-5452d00b0fbb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:47.102762 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-00a1d133-a2a2-40f2-8c14-5452d00b0fbb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:47.103210 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-00a1d133-a2a2-40f2-8c14-5452d00b0fbb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:47.103998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-00a1d133-a2a2-40f2-8c14-5452d00b0fbb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:47.104429 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-00a1d133-a2a2-40f2-8c14-5452d00b0fbb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:47.234293 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-00a1d133-a2a2-40f2-8c14-5452d00b0fbb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:47.242931 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-00a1d133-a2a2-40f2-8c14-5452d00b0fbb tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1312 microversion: 2.1 time: 0.150966 Jun 16 18:08:47.243519 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 184/365] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:47 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:47.752927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d05c2276-a624-42f2-b01c-96d26c42609f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:47.754240 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d05c2276-a624-42f2-b01c-96d26c42609f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:47.761003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d05c2276-a624-42f2-b01c-96d26c42609f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:47.761453 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d05c2276-a624-42f2-b01c-96d26c42609f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:47.762241 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d05c2276-a624-42f2-b01c-96d26c42609f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:47.762680 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d05c2276-a624-42f2-b01c-96d26c42609f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:47.916358 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d05c2276-a624-42f2-b01c-96d26c42609f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:47.926640 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d05c2276-a624-42f2-b01c-96d26c42609f tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1502 microversion: 2.1 time: 0.178108 Jun 16 18:08:47.927224 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 182/366] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:47 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:47.946472 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-81628d36-2f75-417e-a118-98d923133e10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24d2d836-a5ed-4fd8-bce5-df843b6e2ea6"}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:08:47.948703 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-81628d36-2f75-417e-a118-98d923133e10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:47.958161 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-81628d36-2f75-417e-a118-98d923133e10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:47.958865 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-81628d36-2f75-417e-a118-98d923133e10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:47.959828 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-81628d36-2f75-417e-a118-98d923133e10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:47.960344 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-81628d36-2f75-417e-a118-98d923133e10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:47.989452 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-81628d36-2f75-417e-a118-98d923133e10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] HTTP exception thrown: Cannot 'attach_volume' instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 while it is in vm_state rescued Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-81628d36-2f75-417e-a118-98d923133e10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Request method failure captured: Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: POST /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9/os-volume_attachments HTTP/1.1 Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 74 Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3Eq-J0cdT7Q59NKUoZ9-m6io95jrja4nBlLZ2IrmHPjQUc437edozQeIknUqxjH4oxU4tdk87XU_tl9vD01b67d4jh_u74_xK6DIe9tZ4bSiOiMPWaTlez9oD4PgPfEkuLcgt5L68flaxEHxw0SGv-tm0UCwE2jS56Nebwkx8ox4Bg Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: b566750533af4d0d96a3d0e0ffbc45ed Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:08:47.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:08:47.998322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:08:47.998322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:08:47.998322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: b566750533af4d0d96a3d0e0ffbc45ed Jun 16 18:08:47.998322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:08:47.998322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-ServerRescueNegativeTestJSON-1069596980-project Jun 16 18:08:47.998322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:08:47.998322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:08:47.998322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 70d6f15465b84182a28d96d1808a9660 Jun 16 18:08:47.998322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1069596980-project Jun 16 18:08:47.998322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Jun 16 18:08:47.998322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {"volumeAttachment": {"volumeId": "24d2d836-a5ed-4fd8-bce5-df843b6e2ea6"}} Jun 16 18:08:47.998322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Cannot 'attach_volume' instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 while it is in vm_state rescued Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'server_id': '6d859d92-dab1-47f8-85ba-1e86413ceec9', 'body': {'volumeAttachment': {'volumeId': '24d2d836-a5ed-4fd8-bce5-df843b6e2ea6'}}} Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:08:48.005207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 while it is in vm_state rescued Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:48.007191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:48.008906 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:08:48.008906 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:08:48.008906 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 while it is in vm_state rescued Jun 16 18:08:48.008906 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:08:48.008906 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-81628d36-2f75-417e-a118-98d923133e10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Returning 409 to user: Cannot 'attach_volume' instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 while it is in vm_state rescued {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:08:48.008906 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-81628d36-2f75-417e-a118-98d923133e10 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "POST /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051671 Jun 16 18:08:48.008906 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 185/367] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:08:47 2022] POST /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:08:48.009638 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f604b057-664e-4c92-8ad0-684e0a16cb09 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:08:48.009638 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f604b057-664e-4c92-8ad0-684e0a16cb09 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:48.010887 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f604b057-664e-4c92-8ad0-684e0a16cb09 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:48.011333 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f604b057-664e-4c92-8ad0-684e0a16cb09 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:48.012694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f604b057-664e-4c92-8ad0-684e0a16cb09 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:48.013407 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f604b057-664e-4c92-8ad0-684e0a16cb09 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:48.240842 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f604b057-664e-4c92-8ad0-684e0a16cb09 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "POST /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9/action" status: 202 len: 0 microversion: 2.1 time: 0.242554 Jun 16 18:08:48.241639 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 183/368] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:08:47 2022] POST /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:08:48.254394 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-fca7ce6d-9998-42c4-88a8-8defc9912ed0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:48.256524 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-fca7ce6d-9998-42c4-88a8-8defc9912ed0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:48.263319 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-905917c4-db01-47db-86dc-839f4399a954 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:48.263591 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fca7ce6d-9998-42c4-88a8-8defc9912ed0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:48.264045 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-905917c4-db01-47db-86dc-839f4399a954 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:48.264420 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fca7ce6d-9998-42c4-88a8-8defc9912ed0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:48.265845 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fca7ce6d-9998-42c4-88a8-8defc9912ed0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:48.265845 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fca7ce6d-9998-42c4-88a8-8defc9912ed0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:48.272471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-905917c4-db01-47db-86dc-839f4399a954 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:48.272921 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-905917c4-db01-47db-86dc-839f4399a954 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:48.273686 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-905917c4-db01-47db-86dc-839f4399a954 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:48.274114 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-905917c4-db01-47db-86dc-839f4399a954 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:48.487701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-fca7ce6d-9998-42c4-88a8-8defc9912ed0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:48.488213 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-905917c4-db01-47db-86dc-839f4399a954 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:48.492830 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-905917c4-db01-47db-86dc-839f4399a954 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1496 microversion: 2.1 time: 0.235050 Jun 16 18:08:48.495979 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 184/369] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:48 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1496 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:48.497579 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-fca7ce6d-9998-42c4-88a8-8defc9912ed0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1510 microversion: 2.1 time: 0.249965 Jun 16 18:08:48.498338 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 186/370] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:48 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:49.515808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6bccd050-37cc-4785-8c5e-b65339f893a6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:49.516433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6bccd050-37cc-4785-8c5e-b65339f893a6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:49.530727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6bccd050-37cc-4785-8c5e-b65339f893a6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:49.531172 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6bccd050-37cc-4785-8c5e-b65339f893a6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:49.532028 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6bccd050-37cc-4785-8c5e-b65339f893a6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:49.532536 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6bccd050-37cc-4785-8c5e-b65339f893a6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:49.672904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6bccd050-37cc-4785-8c5e-b65339f893a6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:49.681196 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6bccd050-37cc-4785-8c5e-b65339f893a6 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1510 microversion: 2.1 time: 0.169111 Jun 16 18:08:49.681751 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 185/371] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:49 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:50.698835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9049fdba-d71e-4cde-9a95-25e03287e589 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:50.699588 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9049fdba-d71e-4cde-9a95-25e03287e589 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:50.705533 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9049fdba-d71e-4cde-9a95-25e03287e589 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:50.706012 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9049fdba-d71e-4cde-9a95-25e03287e589 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:50.706779 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9049fdba-d71e-4cde-9a95-25e03287e589 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:50.707759 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9049fdba-d71e-4cde-9a95-25e03287e589 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:50.838012 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9049fdba-d71e-4cde-9a95-25e03287e589 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:50.849101 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9049fdba-d71e-4cde-9a95-25e03287e589 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1510 microversion: 2.1 time: 0.151500 Jun 16 18:08:50.849101 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 187/372] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:50 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:50.902893 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5aa214d9-ddec-4a3c-a000-1b1839db5bee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:50.903487 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5aa214d9-ddec-4a3c-a000-1b1839db5bee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:50.906002 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:50.911025 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5aa214d9-ddec-4a3c-a000-1b1839db5bee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:50.911656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5aa214d9-ddec-4a3c-a000-1b1839db5bee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:50.912419 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5aa214d9-ddec-4a3c-a000-1b1839db5bee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:50.912856 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5aa214d9-ddec-4a3c-a000-1b1839db5bee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:50.938214 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5aa214d9-ddec-4a3c-a000-1b1839db5bee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Going to try to terminate instance {{(pid=118162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:08:51.339575 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5aa214d9-ddec-4a3c-a000-1b1839db5bee tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 204 len: 0 microversion: 2.1 time: 0.440207 Jun 16 18:08:51.343471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 186/373] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:08:50 2022] DELETE /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:08:51.349988 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-42a40aec-0ea5-468f-a886-8f6605ac5a12 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:51.350365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-42a40aec-0ea5-468f-a886-8f6605ac5a12 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:51.356465 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-42a40aec-0ea5-468f-a886-8f6605ac5a12 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:51.356909 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-42a40aec-0ea5-468f-a886-8f6605ac5a12 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:51.357659 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-42a40aec-0ea5-468f-a886-8f6605ac5a12 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:51.358085 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-42a40aec-0ea5-468f-a886-8f6605ac5a12 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:51.493707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-42a40aec-0ea5-468f-a886-8f6605ac5a12 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:51.501191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-42a40aec-0ea5-468f-a886-8f6605ac5a12 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1502 microversion: 2.1 time: 0.156414 Jun 16 18:08:51.501746 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 188/374] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:51 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:08:51.865216 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6557c437-bd37-4840-a320-aac23f8704ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:51.865831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6557c437-bd37-4840-a320-aac23f8704ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:51.872029 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6557c437-bd37-4840-a320-aac23f8704ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:51.872480 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6557c437-bd37-4840-a320-aac23f8704ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:51.873237 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6557c437-bd37-4840-a320-aac23f8704ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:51.873672 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6557c437-bd37-4840-a320-aac23f8704ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:52.004782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6557c437-bd37-4840-a320-aac23f8704ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:52.013175 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6557c437-bd37-4840-a320-aac23f8704ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1510 microversion: 2.1 time: 0.152653 Jun 16 18:08:52.013782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 187/375] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:51 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:52.518773 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-21ea2f5a-1812-40be-969c-3b9923d78d0f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:52.519436 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-21ea2f5a-1812-40be-969c-3b9923d78d0f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:52.526414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-21ea2f5a-1812-40be-969c-3b9923d78d0f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:52.526859 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-21ea2f5a-1812-40be-969c-3b9923d78d0f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:52.527693 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-21ea2f5a-1812-40be-969c-3b9923d78d0f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:52.528074 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-21ea2f5a-1812-40be-969c-3b9923d78d0f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:52.656368 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-21ea2f5a-1812-40be-969c-3b9923d78d0f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:52.664186 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-21ea2f5a-1812-40be-969c-3b9923d78d0f tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1502 microversion: 2.1 time: 0.149802 Jun 16 18:08:52.664746 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 189/376] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:52 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:53.030805 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-52320067-5cfb-4fef-8f28-e0fa636db6a7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:53.032343 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-52320067-5cfb-4fef-8f28-e0fa636db6a7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:53.039868 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-52320067-5cfb-4fef-8f28-e0fa636db6a7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:53.047154 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-52320067-5cfb-4fef-8f28-e0fa636db6a7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:53.047154 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-52320067-5cfb-4fef-8f28-e0fa636db6a7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:53.047154 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-52320067-5cfb-4fef-8f28-e0fa636db6a7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:53.062674 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:08:53.183448 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-52320067-5cfb-4fef-8f28-e0fa636db6a7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:53.190840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-52320067-5cfb-4fef-8f28-e0fa636db6a7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1510 microversion: 2.1 time: 0.163914 Jun 16 18:08:53.191600 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 188/377] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:53 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:53.680634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b357eee1-db52-44f5-a437-549a102c1665 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:53.681259 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b357eee1-db52-44f5-a437-549a102c1665 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:53.687238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b357eee1-db52-44f5-a437-549a102c1665 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:53.687717 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b357eee1-db52-44f5-a437-549a102c1665 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:53.688470 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b357eee1-db52-44f5-a437-549a102c1665 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:53.688908 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b357eee1-db52-44f5-a437-549a102c1665 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:53.818863 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b357eee1-db52-44f5-a437-549a102c1665 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:53.826277 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b357eee1-db52-44f5-a437-549a102c1665 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1502 microversion: 2.1 time: 0.149569 Jun 16 18:08:53.826822 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 190/378] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:53 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:54.207054 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4d312e90-229b-4278-a74c-d8aa88ee2697 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:54.211074 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4d312e90-229b-4278-a74c-d8aa88ee2697 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:54.214909 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4d312e90-229b-4278-a74c-d8aa88ee2697 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:54.215378 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4d312e90-229b-4278-a74c-d8aa88ee2697 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:54.216144 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4d312e90-229b-4278-a74c-d8aa88ee2697 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:54.216576 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4d312e90-229b-4278-a74c-d8aa88ee2697 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:54.360181 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4d312e90-229b-4278-a74c-d8aa88ee2697 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:54.367799 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4d312e90-229b-4278-a74c-d8aa88ee2697 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1516 microversion: 2.1 time: 0.164429 Jun 16 18:08:54.368364 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 189/379] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:54 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:54.843064 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-56d4ec44-7d3c-49cb-9efa-7542b9fa10b6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:54.843706 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-56d4ec44-7d3c-49cb-9efa-7542b9fa10b6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:54.849949 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-56d4ec44-7d3c-49cb-9efa-7542b9fa10b6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:54.850391 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-56d4ec44-7d3c-49cb-9efa-7542b9fa10b6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:54.851142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-56d4ec44-7d3c-49cb-9efa-7542b9fa10b6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:54.851600 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-56d4ec44-7d3c-49cb-9efa-7542b9fa10b6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:55.017955 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-56d4ec44-7d3c-49cb-9efa-7542b9fa10b6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:55.027348 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-56d4ec44-7d3c-49cb-9efa-7542b9fa10b6 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1502 microversion: 2.1 time: 0.188022 Jun 16 18:08:55.037504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 191/380] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:54 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:55.105661 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-bc63ae40-3bf5-4cf9-9da5-a73587c71951 req-65dc48e7-8d86-417c-a4bd-f022680a7a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7f6f18-8efb-45b5-88e1-259b5df6ba62", "name": "network-vif-deleted", "tag": "659339da-6967-4ce5-8a6c-886a62e29094"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:08:55.117233 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-bc63ae40-3bf5-4cf9-9da5-a73587c71951 req-65dc48e7-8d86-417c-a4bd-f022680a7a45 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:55.117673 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-bc63ae40-3bf5-4cf9-9da5-a73587c71951 req-65dc48e7-8d86-417c-a4bd-f022680a7a45 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:55.144522 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-bc63ae40-3bf5-4cf9-9da5-a73587c71951 req-65dc48e7-8d86-417c-a4bd-f022680a7a45 service nova] Creating event network-vif-deleted:659339da-6967-4ce5-8a6c-886a62e29094 for instance 7e7f6f18-8efb-45b5-88e1-259b5df6ba62 on hv-cinder-83754 Jun 16 18:08:55.160329 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-bc63ae40-3bf5-4cf9-9da5-a73587c71951 req-65dc48e7-8d86-417c-a4bd-f022680a7a45 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066098 Jun 16 18:08:55.161104 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 190/381] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:08:56.046633 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f7ae1cd4-d8b7-4f9f-9ad3-43a4751d5476 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:56.047532 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f7ae1cd4-d8b7-4f9f-9ad3-43a4751d5476 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:56.053963 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7ae1cd4-d8b7-4f9f-9ad3-43a4751d5476 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:56.054415 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7ae1cd4-d8b7-4f9f-9ad3-43a4751d5476 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:56.055182 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7ae1cd4-d8b7-4f9f-9ad3-43a4751d5476 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:56.055648 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7ae1cd4-d8b7-4f9f-9ad3-43a4751d5476 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:56.086821 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7ae1cd4-d8b7-4f9f-9ad3-43a4751d5476 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:56.087264 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7ae1cd4-d8b7-4f9f-9ad3-43a4751d5476 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:56.087739 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-f7ae1cd4-d8b7-4f9f-9ad3-43a4751d5476 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lazy-loading 'fault' on Instance uuid 7e7f6f18-8efb-45b5-88e1-259b5df6ba62 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:08:56.134412 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f7ae1cd4-d8b7-4f9f-9ad3-43a4751d5476 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84114b0e2d6d4ea4b0b494d8b6e66a0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7385d827292c44cf91ca0689dfc3753a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:08:56.158515 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f7ae1cd4-d8b7-4f9f-9ad3-43a4751d5476 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 200 len: 1302 microversion: 2.1 time: 0.114882 Jun 16 18:08:56.158515 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 192/382] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:56 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 1302 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:08:57.175337 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1a05c2b3-17c7-4277-a24a-02483f8a2889 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:08:57.176066 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1a05c2b3-17c7-4277-a24a-02483f8a2889 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] [instance: 7e7f6f18-8efb-45b5-88e1-259b5df6ba62] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:08:57.183685 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a05c2b3-17c7-4277-a24a-02483f8a2889 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:57.184214 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a05c2b3-17c7-4277-a24a-02483f8a2889 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:57.185057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a05c2b3-17c7-4277-a24a-02483f8a2889 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:08:57.185730 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a05c2b3-17c7-4277-a24a-02483f8a2889 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:08:57.199729 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-1a05c2b3-17c7-4277-a24a-02483f8a2889 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] HTTP exception thrown: Instance 7e7f6f18-8efb-45b5-88e1-259b5df6ba62 could not be found. Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1a05c2b3-17c7-4277-a24a-02483f8a2889 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Request method failure captured: Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 HTTP/1.1 Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3Foab6s469S3tCtE8CbT5Kaxwr3jBg8bvRfxw4ltuVuJeQhvqNJgWrgrY8KrgmrInwVjk81r9Xo3jkO4ClrCCdujq7vTP8dTc1mhJvxluHYSE4klcDsJjX7jOcpM2Xwu54XeylHadHeSGWtzF_0wpN9tHmSt3z0nxeRSAEqLRruZJY Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 7385d827292c44cf91ca0689dfc3753a Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-VolumesActionsTest-924271008 Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:08:57.201414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:08:57.202922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7385d827292c44cf91ca0689dfc3753a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7385d827292c44cf91ca0689dfc3753a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7385d827292c44cf91ca0689dfc3753a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7385d827292c44cf91ca0689dfc3753a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:08:57.202922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-VolumesActionsTest-924271008 Jun 16 18:08:57.202922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 7385d827292c44cf91ca0689dfc3753a Jun 16 18:08:57.202922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-VolumesActionsTest-924271008 Jun 16 18:08:57.202922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-VolumesActionsTest-924271008-project Jun 16 18:08:57.202922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:08:57.202922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:08:57.202922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 84114b0e2d6d4ea4b0b494d8b6e66a0e Jun 16 18:08:57.202922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-VolumesActionsTest-924271008-project Jun 16 18:08:57.202922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:08:57.202922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 7e7f6f18-8efb-45b5-88e1-259b5df6ba62 could not be found. Jun 16 18:08:57.202922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '7e7f6f18-8efb-45b5-88e1-259b5df6ba62'} Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e7f6f18-8efb-45b5-88e1-259b5df6ba62 could not be found. Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:08:57.213046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e7f6f18-8efb-45b5-88e1-259b5df6ba62 could not be found. Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e7f6f18-8efb-45b5-88e1-259b5df6ba62 could not be found. Jun 16 18:08:57.214658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:08:57.215991 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1a05c2b3-17c7-4277-a24a-02483f8a2889 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] Returning 404 to user: Instance 7e7f6f18-8efb-45b5-88e1-259b5df6ba62 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:08:57.215991 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1a05c2b3-17c7-4277-a24a-02483f8a2889 tempest-VolumesActionsTest-924271008 tempest-VolumesActionsTest-924271008-project] 10.222.0.58 "GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62" status: 404 len: 111 microversion: 2.1 time: 0.032175 Jun 16 18:08:57.215991 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 191/383] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:08:57 2022] GET /compute/v2.1/servers/7e7f6f18-8efb-45b5-88e1-259b5df6ba62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:08:57.222528 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-bd7695d4-4304-42b2-9642-9aa73663c4c7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Action: 'create', calling method: .version_select at 0x7f9c30677dc0>, body: {"keypair": {"name": "tempest-keypair-308991458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONpmW0/99hq+5QKOezvd11ojxJqoZIfMQtdHXA28ce10lXX+1j1aCz9a8YsLjuMXkEMupQ66QmW8Xm4mv6e0kuHKlz7SisOqUqrBdbGCQ8SUgSAJXWg4SR6M8UCKLL1Xg=="}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:08:57.239312 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-bd7695d4-4304-42b2-9642-9aa73663c4c7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Getting quotas for project b566750533af4d0d96a3d0e0ffbc45ed. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:08:57.249915 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-bd7695d4-4304-42b2-9642-9aa73663c4c7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Getting quotas for user 70d6f15465b84182a28d96d1808a9660 and project b566750533af4d0d96a3d0e0ffbc45ed. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:08:57.359563 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-bd7695d4-4304-42b2-9642-9aa73663c4c7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.140958 Jun 16 18:08:57.360524 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 193/384] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jun 16 18:08:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:09:00.074617 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1027029808", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a03d1a55-b841-416c-8968-4e0f58b34cf4"}], "security_groups": [{"name": "tempest-securitygroup--1079954643"}], "key_name": "tempest-keypair-308991458", "user_data": "}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:09:00.181240 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.network.neutron [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] validate_networks() for [('a03d1a55-b841-416c-8968-4e0f58b34cf4', None, None, None, None, None)] {{(pid=118162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:09:00.595583 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Flavor limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:09:00.596006 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Image limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:09:00.596478 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Flavor pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:09:00.597067 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Image pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:09:00.597494 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:09:00.607179 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:00.607663 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:00.608465 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:00.608902 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:00.626245 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Getting quotas for project b566750533af4d0d96a3d0e0ffbc45ed. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:09:00.630229 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Getting quotas for user 70d6f15465b84182a28d96d1808a9660 and project b566750533af4d0d96a3d0e0ffbc45ed. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:09:00.642080 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Going to run 1 instances... {{(pid=118162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:09:00.644405 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:09:00.779202 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9137f59b-3538-433e-b871-e182e4685037 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.709540 Jun 16 18:09:00.779874 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 192/385] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:09:00 2022] POST /compute/v2.1/servers => generated 409 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:09:00.790424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-00f35789-0dce-45c1-b55a-e7f4aa4d6417 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:00.791025 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-00f35789-0dce-45c1-b55a-e7f4aa4d6417 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:00.846869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-00f35789-0dce-45c1-b55a-e7f4aa4d6417 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:00.855904 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-00f35789-0dce-45c1-b55a-e7f4aa4d6417 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1245 microversion: 2.1 time: 0.069984 Jun 16 18:09:00.856638 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 194/386] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:00 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:01.876435 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-31bb423b-b5e8-45a8-b889-a68c4c186df5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:01.877048 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-31bb423b-b5e8-45a8-b889-a68c4c186df5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:01.884624 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-31bb423b-b5e8-45a8-b889-a68c4c186df5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:01.885080 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-31bb423b-b5e8-45a8-b889-a68c4c186df5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:01.885858 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-31bb423b-b5e8-45a8-b889-a68c4c186df5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:01.886296 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-31bb423b-b5e8-45a8-b889-a68c4c186df5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:01.952164 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-31bb423b-b5e8-45a8-b889-a68c4c186df5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:01.959583 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-31bb423b-b5e8-45a8-b889-a68c4c186df5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1249 microversion: 2.1 time: 0.087532 Jun 16 18:09:01.960144 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 193/387] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:01 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:02.976043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-25335e61-0492-4fd0-b321-c42233839fd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:02.976651 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-25335e61-0492-4fd0-b321-c42233839fd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:02.982770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-25335e61-0492-4fd0-b321-c42233839fd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:02.983213 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-25335e61-0492-4fd0-b321-c42233839fd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:02.984006 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-25335e61-0492-4fd0-b321-c42233839fd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:02.984436 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-25335e61-0492-4fd0-b321-c42233839fd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:03.268753 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-25335e61-0492-4fd0-b321-c42233839fd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:03.277106 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-25335e61-0492-4fd0-b321-c42233839fd2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1249 microversion: 2.1 time: 0.304995 Jun 16 18:09:03.277695 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 195/388] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:02 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1249 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:04.294881 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-78622b77-2371-4762-ab1c-e2df0242db0e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:04.295517 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-78622b77-2371-4762-ab1c-e2df0242db0e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:04.301904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-78622b77-2371-4762-ab1c-e2df0242db0e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:04.302354 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-78622b77-2371-4762-ab1c-e2df0242db0e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:04.303114 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-78622b77-2371-4762-ab1c-e2df0242db0e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:04.303590 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-78622b77-2371-4762-ab1c-e2df0242db0e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:04.363813 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-78622b77-2371-4762-ab1c-e2df0242db0e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:04.371517 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-78622b77-2371-4762-ab1c-e2df0242db0e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1249 microversion: 2.1 time: 0.080467 Jun 16 18:09:04.372064 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 194/389] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:04 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:05.389295 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-99d855d0-8f5d-49df-a013-8dfb61cd2304 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:05.389904 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-99d855d0-8f5d-49df-a013-8dfb61cd2304 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:05.396045 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-99d855d0-8f5d-49df-a013-8dfb61cd2304 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:05.396487 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-99d855d0-8f5d-49df-a013-8dfb61cd2304 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:05.397505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-99d855d0-8f5d-49df-a013-8dfb61cd2304 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:05.397932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-99d855d0-8f5d-49df-a013-8dfb61cd2304 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:05.459503 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-99d855d0-8f5d-49df-a013-8dfb61cd2304 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:05.467871 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-99d855d0-8f5d-49df-a013-8dfb61cd2304 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1249 microversion: 2.1 time: 0.082673 Jun 16 18:09:05.468430 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 196/390] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:05 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:06.485697 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dac4e836-4327-4bf8-b440-59262db0756e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:06.486307 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-dac4e836-4327-4bf8-b440-59262db0756e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:06.493608 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dac4e836-4327-4bf8-b440-59262db0756e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:06.494064 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dac4e836-4327-4bf8-b440-59262db0756e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:06.494827 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dac4e836-4327-4bf8-b440-59262db0756e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:06.495276 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dac4e836-4327-4bf8-b440-59262db0756e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:06.558735 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dac4e836-4327-4bf8-b440-59262db0756e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:06.566228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-dac4e836-4327-4bf8-b440-59262db0756e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1297 microversion: 2.1 time: 0.084449 Jun 16 18:09:06.566782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 195/391] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:06 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:07.584720 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a8f5d619-654b-43d7-ad1c-0a224b8f311c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:07.585326 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a8f5d619-654b-43d7-ad1c-0a224b8f311c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:07.592191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a8f5d619-654b-43d7-ad1c-0a224b8f311c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:07.592640 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a8f5d619-654b-43d7-ad1c-0a224b8f311c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:07.593394 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a8f5d619-654b-43d7-ad1c-0a224b8f311c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:07.593912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a8f5d619-654b-43d7-ad1c-0a224b8f311c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:07.663916 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a8f5d619-654b-43d7-ad1c-0a224b8f311c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:07.672096 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a8f5d619-654b-43d7-ad1c-0a224b8f311c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1303 microversion: 2.1 time: 0.091372 Jun 16 18:09:07.672744 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 197/392] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:07 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:08.690438 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d04b59e1-6a00-434b-b477-2ffebaf1d97d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:08.691211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d04b59e1-6a00-434b-b477-2ffebaf1d97d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:08.699837 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d04b59e1-6a00-434b-b477-2ffebaf1d97d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:08.700437 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d04b59e1-6a00-434b-b477-2ffebaf1d97d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:08.701061 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d04b59e1-6a00-434b-b477-2ffebaf1d97d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:08.705483 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d04b59e1-6a00-434b-b477-2ffebaf1d97d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:08.875876 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d04b59e1-6a00-434b-b477-2ffebaf1d97d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:08.890009 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d04b59e1-6a00-434b-b477-2ffebaf1d97d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1371 microversion: 2.1 time: 0.203299 Jun 16 18:09:08.890883 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 196/393] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:08 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:09.350326 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-ccb4a30c-c3ed-4d1c-8aa2-87e0a240a53b req-b11d7b17-824d-4d8a-948f-075955ce1ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2de096-32e0-4f4e-835d-4e3ba69263c9", "tag": "b98b0ab2-3cdd-47a1-b37c-1d29f9464d66"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:09:09.370668 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-ccb4a30c-c3ed-4d1c-8aa2-87e0a240a53b req-b11d7b17-824d-4d8a-948f-075955ce1ec1 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:09.371167 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-ccb4a30c-c3ed-4d1c-8aa2-87e0a240a53b req-b11d7b17-824d-4d8a-948f-075955ce1ec1 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:09.400880 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-ccb4a30c-c3ed-4d1c-8aa2-87e0a240a53b req-b11d7b17-824d-4d8a-948f-075955ce1ec1 service nova] Creating event network-changed:b98b0ab2-3cdd-47a1-b37c-1d29f9464d66 for instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 on hv-cinder-83754 Jun 16 18:09:09.407842 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-ccb4a30c-c3ed-4d1c-8aa2-87e0a240a53b req-b11d7b17-824d-4d8a-948f-075955ce1ec1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065890 Jun 16 18:09:09.408896 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 198/394] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:09:09.910951 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-cc449658-5cc4-49a1-9920-6553a6f646cf tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:09.912469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-cc449658-5cc4-49a1-9920-6553a6f646cf tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:09.921452 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cc449658-5cc4-49a1-9920-6553a6f646cf tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:09.924141 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cc449658-5cc4-49a1-9920-6553a6f646cf tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:09.924141 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cc449658-5cc4-49a1-9920-6553a6f646cf tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:09.924141 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cc449658-5cc4-49a1-9920-6553a6f646cf tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:10.246222 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-cc449658-5cc4-49a1-9920-6553a6f646cf tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:10.257246 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-cc449658-5cc4-49a1-9920-6553a6f646cf tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1371 microversion: 2.1 time: 0.351841 Jun 16 18:09:10.258446 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 197/395] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:09 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:11.277084 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=6 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:09:11.299545 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8ab885fb-e1a3-455c-aa15-c5fa47b4fb9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:11.299545 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8ab885fb-e1a3-455c-aa15-c5fa47b4fb9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:11.303239 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8ab885fb-e1a3-455c-aa15-c5fa47b4fb9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:11.303755 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8ab885fb-e1a3-455c-aa15-c5fa47b4fb9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:11.304454 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8ab885fb-e1a3-455c-aa15-c5fa47b4fb9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:11.304903 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8ab885fb-e1a3-455c-aa15-c5fa47b4fb9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:11.512280 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8ab885fb-e1a3-455c-aa15-c5fa47b4fb9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:11.534865 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8ab885fb-e1a3-455c-aa15-c5fa47b4fb9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1371 microversion: 2.1 time: 0.258804 Jun 16 18:09:11.535484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 199/396] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:11 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:12.556548 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e03a1c4a-e0e6-4244-b951-98f2a6fbf724 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:12.556548 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e03a1c4a-e0e6-4244-b951-98f2a6fbf724 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:12.557220 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:09:12.557909 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=6 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:09:12.563590 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e03a1c4a-e0e6-4244-b951-98f2a6fbf724 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:12.564256 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e03a1c4a-e0e6-4244-b951-98f2a6fbf724 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:12.565031 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e03a1c4a-e0e6-4244-b951-98f2a6fbf724 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:12.565462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e03a1c4a-e0e6-4244-b951-98f2a6fbf724 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:12.709703 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e03a1c4a-e0e6-4244-b951-98f2a6fbf724 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:12.717290 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e03a1c4a-e0e6-4244-b951-98f2a6fbf724 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1371 microversion: 2.1 time: 0.168236 Jun 16 18:09:12.718548 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 198/397] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:12 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:13.734602 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e8b62d8a-4cbf-46d2-bb3a-098f8ecd4810 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:13.735210 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e8b62d8a-4cbf-46d2-bb3a-098f8ecd4810 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:13.738092 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:09:13.744180 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e8b62d8a-4cbf-46d2-bb3a-098f8ecd4810 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:13.747477 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e8b62d8a-4cbf-46d2-bb3a-098f8ecd4810 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:13.747477 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e8b62d8a-4cbf-46d2-bb3a-098f8ecd4810 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:13.747477 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e8b62d8a-4cbf-46d2-bb3a-098f8ecd4810 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:13.914487 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e8b62d8a-4cbf-46d2-bb3a-098f8ecd4810 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:13.925676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e8b62d8a-4cbf-46d2-bb3a-098f8ecd4810 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1371 microversion: 2.1 time: 0.195032 Jun 16 18:09:13.926819 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 200/398] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:13 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:14.944015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5d388301-17fb-4e7c-988e-e2d46fc80c86 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:14.945900 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5d388301-17fb-4e7c-988e-e2d46fc80c86 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:14.952923 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5d388301-17fb-4e7c-988e-e2d46fc80c86 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:14.953707 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5d388301-17fb-4e7c-988e-e2d46fc80c86 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:14.955503 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5d388301-17fb-4e7c-988e-e2d46fc80c86 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:14.956211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5d388301-17fb-4e7c-988e-e2d46fc80c86 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:15.150501 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5d388301-17fb-4e7c-988e-e2d46fc80c86 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:15.161287 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5d388301-17fb-4e7c-988e-e2d46fc80c86 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1371 microversion: 2.1 time: 0.220996 Jun 16 18:09:15.162430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 199/399] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:14 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:16.201366 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1741cdf1-4b11-41e9-9c03-c33b6f6be545 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:16.202115 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1741cdf1-4b11-41e9-9c03-c33b6f6be545 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:16.211305 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1741cdf1-4b11-41e9-9c03-c33b6f6be545 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:16.211993 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1741cdf1-4b11-41e9-9c03-c33b6f6be545 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:16.213754 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1741cdf1-4b11-41e9-9c03-c33b6f6be545 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:16.214569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1741cdf1-4b11-41e9-9c03-c33b6f6be545 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:16.225382 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=92 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:09:16.463037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1741cdf1-4b11-41e9-9c03-c33b6f6be545 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:16.476670 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1741cdf1-4b11-41e9-9c03-c33b6f6be545 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1371 microversion: 2.1 time: 0.284400 Jun 16 18:09:16.477642 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 201/400] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:16 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:17.505926 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-9005c387-6a75-4702-a048-9c2676481d7d req-ef9f76d8-b0ac-4a0d-b4b0-013dc7a72750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2de096-32e0-4f4e-835d-4e3ba69263c9", "name": "network-vif-plugged", "status": "completed", "tag": "b98b0ab2-3cdd-47a1-b37c-1d29f9464d66"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:09:17.510425 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-dc3b4e4c-8eb6-4e24-9fc2-e7c4d33f2c1c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:17.517933 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-dc3b4e4c-8eb6-4e24-9fc2-e7c4d33f2c1c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:17.527199 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dc3b4e4c-8eb6-4e24-9fc2-e7c4d33f2c1c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:17.527600 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dc3b4e4c-8eb6-4e24-9fc2-e7c4d33f2c1c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:17.535522 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-9005c387-6a75-4702-a048-9c2676481d7d req-ef9f76d8-b0ac-4a0d-b4b0-013dc7a72750 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:17.540869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dc3b4e4c-8eb6-4e24-9fc2-e7c4d33f2c1c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:17.540869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dc3b4e4c-8eb6-4e24-9fc2-e7c4d33f2c1c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:17.542342 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-9005c387-6a75-4702-a048-9c2676481d7d req-ef9f76d8-b0ac-4a0d-b4b0-013dc7a72750 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:17.565037 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-9005c387-6a75-4702-a048-9c2676481d7d req-ef9f76d8-b0ac-4a0d-b4b0-013dc7a72750 service nova] Creating event network-vif-plugged:b98b0ab2-3cdd-47a1-b37c-1d29f9464d66 for instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 on hv-cinder-83754 Jun 16 18:09:17.571708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-9005c387-6a75-4702-a048-9c2676481d7d req-ef9f76d8-b0ac-4a0d-b4b0-013dc7a72750 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073945 Jun 16 18:09:17.572604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 200/401] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:09:17.810314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-dc3b4e4c-8eb6-4e24-9fc2-e7c4d33f2c1c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:17.824505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-dc3b4e4c-8eb6-4e24-9fc2-e7c4d33f2c1c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1371 microversion: 2.1 time: 0.325383 Jun 16 18:09:17.834951 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 202/402] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:17 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1371 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:18.843823 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-16eb865a-1824-4778-9dfd-85e5c6cb2fe7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:18.846267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-16eb865a-1824-4778-9dfd-85e5c6cb2fe7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:18.871109 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-16eb865a-1824-4778-9dfd-85e5c6cb2fe7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:18.873835 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-16eb865a-1824-4778-9dfd-85e5c6cb2fe7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:18.873835 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-16eb865a-1824-4778-9dfd-85e5c6cb2fe7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:18.873835 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-16eb865a-1824-4778-9dfd-85e5c6cb2fe7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:19.300217 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-16eb865a-1824-4778-9dfd-85e5c6cb2fe7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:19.310017 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-16eb865a-1824-4778-9dfd-85e5c6cb2fe7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1371 microversion: 2.1 time: 0.471302 Jun 16 18:09:19.319452 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 201/403] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:18 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1371 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:20.329697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a5c8a092-c4e9-4a57-abb2-a2a408a046ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:20.330489 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a5c8a092-c4e9-4a57-abb2-a2a408a046ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:20.347853 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a5c8a092-c4e9-4a57-abb2-a2a408a046ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:20.347853 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a5c8a092-c4e9-4a57-abb2-a2a408a046ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:20.347853 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a5c8a092-c4e9-4a57-abb2-a2a408a046ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:20.347853 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a5c8a092-c4e9-4a57-abb2-a2a408a046ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:20.636399 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a5c8a092-c4e9-4a57-abb2-a2a408a046ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:20.646408 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a5c8a092-c4e9-4a57-abb2-a2a408a046ee tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1371 microversion: 2.1 time: 0.320855 Jun 16 18:09:20.657044 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 203/404] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:20 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1371 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:21.665677 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9057785b-4f7d-4336-a73e-2015c94ea8bd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:21.666983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9057785b-4f7d-4336-a73e-2015c94ea8bd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:21.676459 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:09:21.682462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9057785b-4f7d-4336-a73e-2015c94ea8bd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:21.682462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9057785b-4f7d-4336-a73e-2015c94ea8bd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:21.682462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9057785b-4f7d-4336-a73e-2015c94ea8bd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:21.682462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9057785b-4f7d-4336-a73e-2015c94ea8bd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:22.084224 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9057785b-4f7d-4336-a73e-2015c94ea8bd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:09:22.093600 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9057785b-4f7d-4336-a73e-2015c94ea8bd tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1564 microversion: 2.1 time: 0.431994 Jun 16 18:09:22.094276 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 202/405] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:09:21 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1564 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:09:22.117674 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a4fd391b-2ec3-47fd-a2a2-dcc82069ec16 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:09:22.117674 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a4fd391b-2ec3-47fd-a2a2-dcc82069ec16 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:09:22.118328 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a4fd391b-2ec3-47fd-a2a2-dcc82069ec16 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:22.118435 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a4fd391b-2ec3-47fd-a2a2-dcc82069ec16 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:22.119228 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a4fd391b-2ec3-47fd-a2a2-dcc82069ec16 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:22.119697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a4fd391b-2ec3-47fd-a2a2-dcc82069ec16 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:22.236537 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a4fd391b-2ec3-47fd-a2a2-dcc82069ec16 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127886 Jun 16 18:09:22.246889 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 204/406] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jun 16 18:09:22 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:09:24.036703 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-c501fd48-0c16-4cef-8901-15da0cb29dd0 req-4f2ab4ff-d2e7-44d7-9935-a43e39ac7a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2de096-32e0-4f4e-835d-4e3ba69263c9", "tag": "b98b0ab2-3cdd-47a1-b37c-1d29f9464d66"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:09:24.072380 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-c501fd48-0c16-4cef-8901-15da0cb29dd0 req-4f2ab4ff-d2e7-44d7-9935-a43e39ac7a1f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:09:24.073112 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-c501fd48-0c16-4cef-8901-15da0cb29dd0 req-4f2ab4ff-d2e7-44d7-9935-a43e39ac7a1f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:09:24.116873 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-c501fd48-0c16-4cef-8901-15da0cb29dd0 req-4f2ab4ff-d2e7-44d7-9935-a43e39ac7a1f service nova] Creating event network-changed:b98b0ab2-3cdd-47a1-b37c-1d29f9464d66 for instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 on hv-cinder-83754 Jun 16 18:09:24.132116 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-c501fd48-0c16-4cef-8901-15da0cb29dd0 req-4f2ab4ff-d2e7-44d7-9935-a43e39ac7a1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105147 Jun 16 18:09:24.135018 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 203/407] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:09:36.214072 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=9 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:09:36.214072 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=21 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:09:36.500365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-01cbe915-c9e3-4d95-9f63-a7a993c9773f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Action: 'create', calling method: .version_select at 0x7f9c3061e9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1852837450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgAkDeiwf6UhXx4yvPpXhBlucaIH+GSzlHBTBuVc1z43QgDfTh4NbhNsL5rAV3QX/7gGcapnD4Z9qauX0vso7RITHbamXm3CG0kUwhBx+E7pxiXvfuQBRbiNV0P+s+5aw=="}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:09:36.516440 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-01cbe915-c9e3-4d95-9f63-a7a993c9773f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Getting quotas for project bdb225966010445785ba6d65c068176c. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:09:36.520765 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-01cbe915-c9e3-4d95-9f63-a7a993c9773f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Getting quotas for user 2311f0b1e7074500a6964504a7aee218 and project bdb225966010445785ba6d65c068176c. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:09:36.713315 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-01cbe915-c9e3-4d95-9f63-a7a993c9773f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.504957 Jun 16 18:09:36.713908 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 205/408] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jun 16 18:09:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:10:03.768560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a37d0ca6-b348-4847-a32b-eb6c1048b559 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:03.769250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a37d0ca6-b348-4847-a32b-eb6c1048b559 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:03.771577 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=72 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:03.777587 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a37d0ca6-b348-4847-a32b-eb6c1048b559 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:03.778077 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a37d0ca6-b348-4847-a32b-eb6c1048b559 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:03.778845 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a37d0ca6-b348-4847-a32b-eb6c1048b559 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:03.779326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a37d0ca6-b348-4847-a32b-eb6c1048b559 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:03.803714 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a37d0ca6-b348-4847-a32b-eb6c1048b559 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/ips" status: 200 len: 150 microversion: 2.1 time: 0.039431 Jun 16 18:10:03.804514 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 204/409] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jun 16 18:10:03 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:10:04.868188 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:10:04.868832 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Thu Jun 16 18:10:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:10:09.745925 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=4 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:09.747397 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:09.750879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f975edae-e287-44fb-a951-12910ae6a6bc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aea07d3e-d5e1-4df1-8c9a-818559cb5782"}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:09.751973 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f975edae-e287-44fb-a951-12910ae6a6bc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:09.757891 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f975edae-e287-44fb-a951-12910ae6a6bc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:09.760936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f975edae-e287-44fb-a951-12910ae6a6bc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:09.760936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f975edae-e287-44fb-a951-12910ae6a6bc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:09.760936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f975edae-e287-44fb-a951-12910ae6a6bc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:09.798858 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f681a617-a2fb-422c-aa9f-e7bd7623d353 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:09.799957 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f681a617-a2fb-422c-aa9f-e7bd7623d353 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:09.806959 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f681a617-a2fb-422c-aa9f-e7bd7623d353 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:09.807269 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f681a617-a2fb-422c-aa9f-e7bd7623d353 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:09.808165 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f681a617-a2fb-422c-aa9f-e7bd7623d353 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:09.808614 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f681a617-a2fb-422c-aa9f-e7bd7623d353 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:09.835405 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f681a617-a2fb-422c-aa9f-e7bd7623d353 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/ips" status: 200 len: 146 microversion: 2.1 time: 0.041146 Jun 16 18:10:09.840360 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 205/410] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jun 16 18:10:09 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:10:10.614795 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f975edae-e287-44fb-a951-12910ae6a6bc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.866160 Jun 16 18:10:10.614795 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 206/411] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:10:09 2022] POST /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/os-volume_attachments => generated 194 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:10:14.003112 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-228465041", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1852837450", "security_groups": [{"name": "tempest-secgroup-smoke-524220426"}], "networks": [{"uuid": "65509748-42d2-4023-8e8d-2aa234edb5bb"}], "block_device_mapping_v2": [{"uuid": "de6f9ddc-5084-42f5-859c-328ce909c954", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:14.121647 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.network.neutron [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] validate_networks() for [('65509748-42d2-4023-8e8d-2aa234edb5bb', None, None, None, None, None)] {{(pid=118162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:10:14.322333 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d21e612e-69d6-4357-8862-9afc54c2acae tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1df85a5e-c0d9-4dbb-ab8c-7187b171b17a"}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:14.323648 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d21e612e-69d6-4357-8862-9afc54c2acae tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:14.337936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d21e612e-69d6-4357-8862-9afc54c2acae tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:14.337936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d21e612e-69d6-4357-8862-9afc54c2acae tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:14.337936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d21e612e-69d6-4357-8862-9afc54c2acae tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:14.337936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d21e612e-69d6-4357-8862-9afc54c2acae tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:14.530004 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Flavor limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:10:14.530414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Image limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:10:14.531851 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Flavor pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:10:14.532618 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Image pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:10:14.533047 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:10:14.544877 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:14.555221 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:14.555221 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:14.555221 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:14.563073 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Getting quotas for project bdb225966010445785ba6d65c068176c. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:10:14.567103 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Getting quotas for user 2311f0b1e7074500a6964504a7aee218 and project bdb225966010445785ba6d65c068176c. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:10:14.630984 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Going to run 1 instances... {{(pid=118162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:10:14.633273 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de6f9ddc-5084-42f5-859c-328ce909c954',volume_size=None,volume_type=None)] {{(pid=118162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:10:15.244138 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-dc7217d5-5712-46ab-8937-0c87c0a899f8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.244995 Jun 16 18:10:15.245534 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 206/412] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:10:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:10:15.254745 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-32d9dc01-a7ca-42ac-b0f9-e1ee23122b0f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:15.255460 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-32d9dc01-a7ca-42ac-b0f9-e1ee23122b0f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:15.320854 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-32d9dc01-a7ca-42ac-b0f9-e1ee23122b0f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:15.329124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-32d9dc01-a7ca-42ac-b0f9-e1ee23122b0f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1088 microversion: 2.1 time: 0.078016 Jun 16 18:10:15.329628 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 207/413] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:15 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:15.374586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d21e612e-69d6-4357-8862-9afc54c2acae tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "POST /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.056438 Jun 16 18:10:15.375667 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 207/414] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:10:14 2022] POST /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/os-volume_attachments => generated 194 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:10:16.347526 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a032d1cd-ff64-4d9e-bdf9-5b3e13e466ee tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:16.348143 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a032d1cd-ff64-4d9e-bdf9-5b3e13e466ee tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:16.401495 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a032d1cd-ff64-4d9e-bdf9-5b3e13e466ee tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:16.409547 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a032d1cd-ff64-4d9e-bdf9-5b3e13e466ee tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1088 microversion: 2.1 time: 0.065877 Jun 16 18:10:16.410115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 208/415] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:16 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:17.429288 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-86dfce56-996a-4091-b493-9257504cdb14 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:17.430001 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-86dfce56-996a-4091-b493-9257504cdb14 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:17.436714 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-86dfce56-996a-4091-b493-9257504cdb14 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:17.437166 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-86dfce56-996a-4091-b493-9257504cdb14 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:17.438593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-86dfce56-996a-4091-b493-9257504cdb14 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:17.439185 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-86dfce56-996a-4091-b493-9257504cdb14 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:17.506795 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-86dfce56-996a-4091-b493-9257504cdb14 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:17.517062 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-86dfce56-996a-4091-b493-9257504cdb14 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1130 microversion: 2.1 time: 0.093306 Jun 16 18:10:17.517062 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 208/416] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:17 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1130 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:18.533498 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a878cb81-714b-4c9e-aa22-475ea0d21bfc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:18.534063 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a878cb81-714b-4c9e-aa22-475ea0d21bfc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:18.541267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a878cb81-714b-4c9e-aa22-475ea0d21bfc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:18.541709 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a878cb81-714b-4c9e-aa22-475ea0d21bfc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:18.542478 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a878cb81-714b-4c9e-aa22-475ea0d21bfc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:18.542911 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a878cb81-714b-4c9e-aa22-475ea0d21bfc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:18.614204 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a878cb81-714b-4c9e-aa22-475ea0d21bfc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:18.621935 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a878cb81-714b-4c9e-aa22-475ea0d21bfc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1186 microversion: 2.1 time: 0.093212 Jun 16 18:10:18.622497 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 209/417] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:18 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:19.443409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-751acb28-e54b-4364-b038-cdaad203bf6d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: .version_select at 0x7f9c3068bb80>, body: {"keypair": {"name": "tempest-keypair-2083367325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5CWR+fSuLkTu8leMO04Q3xUZXM+N4tuNeCeXLch75FbjpFa49Pv6Heeu7Zj/55jiQLakz7eHkpp+nc7rJKknjS+HWxusC+YvbKbtd2kC+Kl6M3O7cdmi3XwWlqqKBeBg=="}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:19.458158 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-751acb28-e54b-4364-b038-cdaad203bf6d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:10:19.462091 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-751acb28-e54b-4364-b038-cdaad203bf6d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for user 8498989e673d445dbc70aa9df55f391b and project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:10:19.542235 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-26cb71d0-8ef0-4ed6-9fdc-7f1a493dd54b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:19.542789 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-26cb71d0-8ef0-4ed6-9fdc-7f1a493dd54b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:19.550125 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-26cb71d0-8ef0-4ed6-9fdc-7f1a493dd54b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:19.550578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-26cb71d0-8ef0-4ed6-9fdc-7f1a493dd54b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:19.551399 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-26cb71d0-8ef0-4ed6-9fdc-7f1a493dd54b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:19.551838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-26cb71d0-8ef0-4ed6-9fdc-7f1a493dd54b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:19.577347 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-26cb71d0-8ef0-4ed6-9fdc-7f1a493dd54b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/ips" status: 200 len: 152 microversion: 2.20 time: 0.038964 Jun 16 18:10:19.590414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 210/418] 10.222.0.58 () {60 vars in 1288 bytes} [Thu Jun 16 18:10:19 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:10:19.590982 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-751acb28-e54b-4364-b038-cdaad203bf6d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.141892 Jun 16 18:10:19.590982 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 209/419] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jun 16 18:10:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:10:19.638977 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-384d79da-6d2f-4b25-b3f6-218bb49d6bb0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:19.639207 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-384d79da-6d2f-4b25-b3f6-218bb49d6bb0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:19.645824 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-384d79da-6d2f-4b25-b3f6-218bb49d6bb0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:19.646323 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-384d79da-6d2f-4b25-b3f6-218bb49d6bb0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:19.647047 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-384d79da-6d2f-4b25-b3f6-218bb49d6bb0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:19.647508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-384d79da-6d2f-4b25-b3f6-218bb49d6bb0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:19.718821 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-384d79da-6d2f-4b25-b3f6-218bb49d6bb0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:19.728446 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-384d79da-6d2f-4b25-b3f6-218bb49d6bb0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1194 microversion: 2.1 time: 0.093563 Jun 16 18:10:19.729548 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 211/420] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:19 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:20.746688 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-eec63c47-8a4f-44ca-9f66-4195b6334239 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:20.747821 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-eec63c47-8a4f-44ca-9f66-4195b6334239 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:20.758826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eec63c47-8a4f-44ca-9f66-4195b6334239 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:20.759514 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eec63c47-8a4f-44ca-9f66-4195b6334239 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:20.760784 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eec63c47-8a4f-44ca-9f66-4195b6334239 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:20.761375 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eec63c47-8a4f-44ca-9f66-4195b6334239 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:20.934722 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-eec63c47-8a4f-44ca-9f66-4195b6334239 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:20.943832 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-eec63c47-8a4f-44ca-9f66-4195b6334239 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1271 microversion: 2.1 time: 0.201284 Jun 16 18:10:20.953869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 210/421] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:20 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:21.721890 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-72240754-3380-4c82-b78d-0f4933bb4939 req-4228d026-8c14-4e6a-aca0-868d0002fc9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6c9426-2d6f-4dfb-8bc8-959827d8cf79", "tag": "aaf3fae1-693c-4fec-8e06-dc30896dc3f7"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:21.731321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-72240754-3380-4c82-b78d-0f4933bb4939 req-4228d026-8c14-4e6a-aca0-868d0002fc9b service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:21.731722 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-72240754-3380-4c82-b78d-0f4933bb4939 req-4228d026-8c14-4e6a-aca0-868d0002fc9b service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:21.744271 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-72240754-3380-4c82-b78d-0f4933bb4939 req-4228d026-8c14-4e6a-aca0-868d0002fc9b service nova] Creating event network-changed:aaf3fae1-693c-4fec-8e06-dc30896dc3f7 for instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79 on hv-cinder-83754 Jun 16 18:10:21.749468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-72240754-3380-4c82-b78d-0f4933bb4939 req-4228d026-8c14-4e6a-aca0-868d0002fc9b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032659 Jun 16 18:10:21.750070 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 212/422] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:10:21.962473 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-75a3671d-1558-4027-95c9-46e15a2c31ea tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:21.962473 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-75a3671d-1558-4027-95c9-46e15a2c31ea tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:21.969167 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-75a3671d-1558-4027-95c9-46e15a2c31ea tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:21.969685 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-75a3671d-1558-4027-95c9-46e15a2c31ea tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:21.971429 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-75a3671d-1558-4027-95c9-46e15a2c31ea tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:21.972005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-75a3671d-1558-4027-95c9-46e15a2c31ea tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:22.190788 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-75a3671d-1558-4027-95c9-46e15a2c31ea tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:22.200898 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-75a3671d-1558-4027-95c9-46e15a2c31ea tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1271 microversion: 2.1 time: 0.243181 Jun 16 18:10:22.202370 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 211/423] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:21 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1271 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:22.435663 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-437605797", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f17e2725-a961-43b0-9ec4-3a8964c308ae"}], "security_groups": [{"name": "tempest-securitygroup--1819379860"}], "key_name": "tempest-keypair-2083367325", "user_data": "}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:22.571599 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.network.neutron [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] validate_networks() for [('f17e2725-a961-43b0-9ec4-3a8964c308ae', None, None, None, None, None)] {{(pid=118162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:10:22.988609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Flavor limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:10:22.989265 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Image limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:10:22.989524 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Flavor pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:10:22.989940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Image pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:10:22.990405 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:10:23.006491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:23.006937 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:23.007848 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:23.008360 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:23.022246 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ebb15125-e59d-4654-9c3b-0a554c4ace61 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:23.022936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ebb15125-e59d-4654-9c3b-0a554c4ace61 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:23.029056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:10:23.029342 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ebb15125-e59d-4654-9c3b-0a554c4ace61 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:23.029796 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ebb15125-e59d-4654-9c3b-0a554c4ace61 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:23.030567 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ebb15125-e59d-4654-9c3b-0a554c4ace61 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:23.031004 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ebb15125-e59d-4654-9c3b-0a554c4ace61 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:23.033574 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for user 8498989e673d445dbc70aa9df55f391b and project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:10:23.045541 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Going to run 1 instances... {{(pid=118162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:10:23.048009 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:10:23.055099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-ebb15125-e59d-4654-9c3b-0a554c4ace61 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lazy-loading 'flavor' on Instance uuid 279175ca-aad1-40da-a191-4712cbd17771 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:10:23.310828 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-db61db82-90df-4528-b69b-03215101d1a3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.879798 Jun 16 18:10:23.317281 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 213/424] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:10:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:10:23.322558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3fb8e9ee-026b-4ed5-8fbf-fae771cdfe17 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:23.323174 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3fb8e9ee-026b-4ed5-8fbf-fae771cdfe17 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:23.335756 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3fb8e9ee-026b-4ed5-8fbf-fae771cdfe17 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:23.336294 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3fb8e9ee-026b-4ed5-8fbf-fae771cdfe17 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:23.337164 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3fb8e9ee-026b-4ed5-8fbf-fae771cdfe17 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:23.337691 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3fb8e9ee-026b-4ed5-8fbf-fae771cdfe17 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:23.484241 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3fb8e9ee-026b-4ed5-8fbf-fae771cdfe17 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:23.493768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3fb8e9ee-026b-4ed5-8fbf-fae771cdfe17 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1271 microversion: 2.1 time: 0.175132 Jun 16 18:10:23.494325 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 214/425] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:23 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:23.499304 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-07287399-e1b3-4b07-b2a9-03e1aa9b2a63 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:23.500079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-07287399-e1b3-4b07-b2a9-03e1aa9b2a63 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:23.557056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-07287399-e1b3-4b07-b2a9-03e1aa9b2a63 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:23.566436 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-07287399-e1b3-4b07-b2a9-03e1aa9b2a63 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1241 microversion: 2.1 time: 0.070825 Jun 16 18:10:23.566909 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 215/426] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:23 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:23.771447 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ebb15125-e59d-4654-9c3b-0a554c4ace61 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "POST /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/action" status: 202 len: 0 microversion: 2.20 time: 0.753051 Jun 16 18:10:23.772072 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 212/427] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Jun 16 18:10:23 2022] POST /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/action => generated 0 bytes in 755 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:10:23.780909 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8c8e6e5f-8a33-4666-a244-270a883e4e9b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:23.781515 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8c8e6e5f-8a33-4666-a244-270a883e4e9b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:23.789655 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8c8e6e5f-8a33-4666-a244-270a883e4e9b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:23.790107 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8c8e6e5f-8a33-4666-a244-270a883e4e9b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:23.790948 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8c8e6e5f-8a33-4666-a244-270a883e4e9b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:23.791419 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8c8e6e5f-8a33-4666-a244-270a883e4e9b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:23.929179 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8c8e6e5f-8a33-4666-a244-270a883e4e9b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:23.937508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8c8e6e5f-8a33-4666-a244-270a883e4e9b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:23.939214 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8c8e6e5f-8a33-4666-a244-270a883e4e9b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:23.940388 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8c8e6e5f-8a33-4666-a244-270a883e4e9b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.163667 Jun 16 18:10:23.940944 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 216/428] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:23 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:24.512880 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-72b4868f-8a8d-4a97-9ce1-502c5d908d15 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:24.514459 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-72b4868f-8a8d-4a97-9ce1-502c5d908d15 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:24.522242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-72b4868f-8a8d-4a97-9ce1-502c5d908d15 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:24.522734 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-72b4868f-8a8d-4a97-9ce1-502c5d908d15 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:24.523560 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-72b4868f-8a8d-4a97-9ce1-502c5d908d15 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:24.523991 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-72b4868f-8a8d-4a97-9ce1-502c5d908d15 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:24.583600 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6b8dd438-f81e-4aa8-a08b-fd4010153ed7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:24.584232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6b8dd438-f81e-4aa8-a08b-fd4010153ed7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:24.590358 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6b8dd438-f81e-4aa8-a08b-fd4010153ed7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:24.590872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6b8dd438-f81e-4aa8-a08b-fd4010153ed7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:24.591783 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6b8dd438-f81e-4aa8-a08b-fd4010153ed7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:24.592864 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6b8dd438-f81e-4aa8-a08b-fd4010153ed7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:24.681883 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6b8dd438-f81e-4aa8-a08b-fd4010153ed7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:24.692384 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6b8dd438-f81e-4aa8-a08b-fd4010153ed7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1245 microversion: 2.1 time: 0.112963 Jun 16 18:10:24.692959 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 217/429] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:24 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1245 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:24.704000 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-72b4868f-8a8d-4a97-9ce1-502c5d908d15 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:24.714519 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-72b4868f-8a8d-4a97-9ce1-502c5d908d15 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1271 microversion: 2.1 time: 0.206394 Jun 16 18:10:24.715102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 213/430] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:24 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:24.960560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-7ebb238c-f4c2-4b37-9b48-d66be554a09a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:24.961178 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-7ebb238c-f4c2-4b37-9b48-d66be554a09a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:24.969145 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7ebb238c-f4c2-4b37-9b48-d66be554a09a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:24.969684 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7ebb238c-f4c2-4b37-9b48-d66be554a09a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:24.971323 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7ebb238c-f4c2-4b37-9b48-d66be554a09a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:24.971787 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7ebb238c-f4c2-4b37-9b48-d66be554a09a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:25.124336 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7ebb238c-f4c2-4b37-9b48-d66be554a09a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:25.133600 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7ebb238c-f4c2-4b37-9b48-d66be554a09a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:25.135133 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7ebb238c-f4c2-4b37-9b48-d66be554a09a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:25.136366 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-7ebb238c-f4c2-4b37-9b48-d66be554a09a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.180032 Jun 16 18:10:25.136927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 218/431] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:24 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:25.710982 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-10582c50-a651-46df-87e7-ead285171537 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:25.711820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-10582c50-a651-46df-87e7-ead285171537 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:25.720001 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-10582c50-a651-46df-87e7-ead285171537 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:25.720457 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-10582c50-a651-46df-87e7-ead285171537 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:25.721377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-10582c50-a651-46df-87e7-ead285171537 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:25.721866 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-10582c50-a651-46df-87e7-ead285171537 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:25.737549 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8c5202e7-4798-46ef-9ed1-dd36d7c07bf8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:25.738452 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8c5202e7-4798-46ef-9ed1-dd36d7c07bf8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:25.744752 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8c5202e7-4798-46ef-9ed1-dd36d7c07bf8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:25.745192 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8c5202e7-4798-46ef-9ed1-dd36d7c07bf8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:25.745966 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8c5202e7-4798-46ef-9ed1-dd36d7c07bf8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:25.746400 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8c5202e7-4798-46ef-9ed1-dd36d7c07bf8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:25.807022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-10582c50-a651-46df-87e7-ead285171537 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:25.822586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-10582c50-a651-46df-87e7-ead285171537 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1293 microversion: 2.1 time: 0.115863 Jun 16 18:10:25.823555 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 214/432] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:25 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:25.925262 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8c5202e7-4798-46ef-9ed1-dd36d7c07bf8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:25.933945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8c5202e7-4798-46ef-9ed1-dd36d7c07bf8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1271 microversion: 2.1 time: 0.204494 Jun 16 18:10:25.934568 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 219/433] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:25 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:26.158833 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3d35af18-fa04-4d39-8d70-416efd312787 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:26.159512 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3d35af18-fa04-4d39-8d70-416efd312787 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:26.166617 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3d35af18-fa04-4d39-8d70-416efd312787 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:26.167070 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3d35af18-fa04-4d39-8d70-416efd312787 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:26.168019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3d35af18-fa04-4d39-8d70-416efd312787 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:26.168476 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3d35af18-fa04-4d39-8d70-416efd312787 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:26.339619 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3d35af18-fa04-4d39-8d70-416efd312787 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:26.348460 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3d35af18-fa04-4d39-8d70-416efd312787 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:26.349961 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3d35af18-fa04-4d39-8d70-416efd312787 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:26.354645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3d35af18-fa04-4d39-8d70-416efd312787 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.197544 Jun 16 18:10:26.354645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 215/434] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:26 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:26.841251 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-7ef5e1c0-45a1-488c-8533-e555f60f93c6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:26.842049 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-7ef5e1c0-45a1-488c-8533-e555f60f93c6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:26.850040 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7ef5e1c0-45a1-488c-8533-e555f60f93c6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:26.850489 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7ef5e1c0-45a1-488c-8533-e555f60f93c6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:26.851265 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7ef5e1c0-45a1-488c-8533-e555f60f93c6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:26.851739 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7ef5e1c0-45a1-488c-8533-e555f60f93c6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:26.944156 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7ef5e1c0-45a1-488c-8533-e555f60f93c6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:26.951110 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-db04e08b-e938-4504-9198-c42cf2768c27 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:26.951812 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-db04e08b-e938-4504-9198-c42cf2768c27 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:26.952923 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-7ef5e1c0-45a1-488c-8533-e555f60f93c6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1301 microversion: 2.1 time: 0.115526 Jun 16 18:10:26.959541 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-db04e08b-e938-4504-9198-c42cf2768c27 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:26.961213 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-db04e08b-e938-4504-9198-c42cf2768c27 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:26.961993 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-db04e08b-e938-4504-9198-c42cf2768c27 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:26.962618 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-db04e08b-e938-4504-9198-c42cf2768c27 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:26.963324 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 220/435] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:26 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1301 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:27.115908 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-db04e08b-e938-4504-9198-c42cf2768c27 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:27.124670 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-db04e08b-e938-4504-9198-c42cf2768c27 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1271 microversion: 2.1 time: 0.177597 Jun 16 18:10:27.125271 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 216/436] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:26 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:27.374139 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2d83c9e5-0015-49fc-bc09-c03db6d30d18 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:27.374971 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2d83c9e5-0015-49fc-bc09-c03db6d30d18 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:27.384250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2d83c9e5-0015-49fc-bc09-c03db6d30d18 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:27.384901 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2d83c9e5-0015-49fc-bc09-c03db6d30d18 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:27.385907 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2d83c9e5-0015-49fc-bc09-c03db6d30d18 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:27.386595 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2d83c9e5-0015-49fc-bc09-c03db6d30d18 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:27.466694 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0eaa843f-fb74-411f-9c29-d27998571fd7 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:27.475487 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0eaa843f-fb74-411f-9c29-d27998571fd7 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:27.475702 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0eaa843f-fb74-411f-9c29-d27998571fd7 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:27.576780 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0eaa843f-fb74-411f-9c29-d27998571fd7 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Going to try to stop instance {{(pid=118161) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:10:27.594175 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2d83c9e5-0015-49fc-bc09-c03db6d30d18 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:27.605534 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2d83c9e5-0015-49fc-bc09-c03db6d30d18 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:27.607747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2d83c9e5-0015-49fc-bc09-c03db6d30d18 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:27.609457 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2d83c9e5-0015-49fc-bc09-c03db6d30d18 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.242866 Jun 16 18:10:27.610226 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 221/437] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:27 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:27.718795 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:27.837437 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0eaa843f-fb74-411f-9c29-d27998571fd7 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "POST /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/action" status: 202 len: 0 microversion: 2.1 time: 0.374519 Jun 16 18:10:27.838054 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 217/438] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:10:27 2022] POST /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:10:27.846758 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d6bcf004-2c75-407b-8d4c-ee9b9a09100f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:27.847398 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d6bcf004-2c75-407b-8d4c-ee9b9a09100f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:27.854133 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d6bcf004-2c75-407b-8d4c-ee9b9a09100f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:27.854572 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d6bcf004-2c75-407b-8d4c-ee9b9a09100f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:27.855382 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d6bcf004-2c75-407b-8d4c-ee9b9a09100f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:27.855823 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d6bcf004-2c75-407b-8d4c-ee9b9a09100f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:27.974595 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-adc359b3-eefb-488c-a650-ff3eb15af5c8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:27.979833 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-adc359b3-eefb-488c-a650-ff3eb15af5c8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:27.992212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-adc359b3-eefb-488c-a650-ff3eb15af5c8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:27.992212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-adc359b3-eefb-488c-a650-ff3eb15af5c8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:27.992212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-adc359b3-eefb-488c-a650-ff3eb15af5c8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:27.992212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-adc359b3-eefb-488c-a650-ff3eb15af5c8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:28.010945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d6bcf004-2c75-407b-8d4c-ee9b9a09100f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:28.021583 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d6bcf004-2c75-407b-8d4c-ee9b9a09100f tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.179132 Jun 16 18:10:28.022236 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 222/439] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:27 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:28.065741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-adc359b3-eefb-488c-a650-ff3eb15af5c8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:28.081940 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-adc359b3-eefb-488c-a650-ff3eb15af5c8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1299 microversion: 2.1 time: 0.111513 Jun 16 18:10:28.082890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 218/440] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:27 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:28.148469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d1c7e9ac-3241-4444-be02-5cbea4aa4531 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:28.149081 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d1c7e9ac-3241-4444-be02-5cbea4aa4531 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:28.162676 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d1c7e9ac-3241-4444-be02-5cbea4aa4531 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:28.163599 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d1c7e9ac-3241-4444-be02-5cbea4aa4531 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:28.164848 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d1c7e9ac-3241-4444-be02-5cbea4aa4531 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:28.165495 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d1c7e9ac-3241-4444-be02-5cbea4aa4531 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:28.335678 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d1c7e9ac-3241-4444-be02-5cbea4aa4531 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:28.343590 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d1c7e9ac-3241-4444-be02-5cbea4aa4531 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1271 microversion: 2.1 time: 0.198890 Jun 16 18:10:28.344257 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 223/441] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:28 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:28.628681 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-636ae014-fe21-4d84-9de1-e7ddb05d7a8e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:28.637265 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-636ae014-fe21-4d84-9de1-e7ddb05d7a8e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:28.644585 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-636ae014-fe21-4d84-9de1-e7ddb05d7a8e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:28.645030 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-636ae014-fe21-4d84-9de1-e7ddb05d7a8e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:28.645799 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-636ae014-fe21-4d84-9de1-e7ddb05d7a8e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:28.646248 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-636ae014-fe21-4d84-9de1-e7ddb05d7a8e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:28.788072 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-636ae014-fe21-4d84-9de1-e7ddb05d7a8e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:28.800081 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-636ae014-fe21-4d84-9de1-e7ddb05d7a8e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:28.816844 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-636ae014-fe21-4d84-9de1-e7ddb05d7a8e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:28.816844 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-636ae014-fe21-4d84-9de1-e7ddb05d7a8e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.178356 Jun 16 18:10:28.816844 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 219/442] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:28 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:10:29.042523 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5ee60ada-2d1e-45da-bab5-f3458667cf40 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:29.043687 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5ee60ada-2d1e-45da-bab5-f3458667cf40 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:29.064178 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5ee60ada-2d1e-45da-bab5-f3458667cf40 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:29.064178 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5ee60ada-2d1e-45da-bab5-f3458667cf40 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:29.064178 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5ee60ada-2d1e-45da-bab5-f3458667cf40 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:29.064178 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5ee60ada-2d1e-45da-bab5-f3458667cf40 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:29.102652 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-18cd5067-21c0-418c-b1fd-18657e75b653 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:29.103932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-18cd5067-21c0-418c-b1fd-18657e75b653 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:29.112647 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-18cd5067-21c0-418c-b1fd-18657e75b653 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:29.113673 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-18cd5067-21c0-418c-b1fd-18657e75b653 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:29.114677 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-18cd5067-21c0-418c-b1fd-18657e75b653 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:29.115302 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-18cd5067-21c0-418c-b1fd-18657e75b653 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:29.311887 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5ee60ada-2d1e-45da-bab5-f3458667cf40 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:29.329582 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-18cd5067-21c0-418c-b1fd-18657e75b653 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:29.340435 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5ee60ada-2d1e-45da-bab5-f3458667cf40 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.299120 Jun 16 18:10:29.340435 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 224/443] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:29 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:29.340712 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-18cd5067-21c0-418c-b1fd-18657e75b653 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.243884 Jun 16 18:10:29.340935 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 220/444] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:29 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:29.362899 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-00a0467a-1c7f-4871-80fd-9150e40418e2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:29.363563 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-00a0467a-1c7f-4871-80fd-9150e40418e2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:29.369959 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-00a0467a-1c7f-4871-80fd-9150e40418e2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:29.370393 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-00a0467a-1c7f-4871-80fd-9150e40418e2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:29.371171 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-00a0467a-1c7f-4871-80fd-9150e40418e2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:29.371622 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-00a0467a-1c7f-4871-80fd-9150e40418e2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:29.441285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-bbbf02e6-c226-4620-b14c-5e9a283f19a6 req-bdd43216-d693-44d9-91cd-1b5d3ed313f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a820253-c5ce-455d-9bf7-ded303efc37c", "tag": "e95f3b78-5899-46e2-9295-d2c2a36592f2"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:29.452620 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-bbbf02e6-c226-4620-b14c-5e9a283f19a6 req-bdd43216-d693-44d9-91cd-1b5d3ed313f5 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:29.453544 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-bbbf02e6-c226-4620-b14c-5e9a283f19a6 req-bdd43216-d693-44d9-91cd-1b5d3ed313f5 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:29.474474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=4 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:29.479413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-bbbf02e6-c226-4620-b14c-5e9a283f19a6 req-bdd43216-d693-44d9-91cd-1b5d3ed313f5 service nova] Creating event network-changed:e95f3b78-5899-46e2-9295-d2c2a36592f2 for instance 3a820253-c5ce-455d-9bf7-ded303efc37c on hv-cinder-83754 Jun 16 18:10:29.486734 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-bbbf02e6-c226-4620-b14c-5e9a283f19a6 req-bdd43216-d693-44d9-91cd-1b5d3ed313f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053930 Jun 16 18:10:29.487925 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 221/445] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:10:29.607913 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-00a0467a-1c7f-4871-80fd-9150e40418e2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:29.622369 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-00a0467a-1c7f-4871-80fd-9150e40418e2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1271 microversion: 2.1 time: 0.263876 Jun 16 18:10:29.623337 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 225/446] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:29 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1271 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:29.822981 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c6c8c94f-ec21-4e3d-ab84-f461daa4dc05 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:29.823717 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c6c8c94f-ec21-4e3d-ab84-f461daa4dc05 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:29.831114 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c6c8c94f-ec21-4e3d-ab84-f461daa4dc05 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:29.831684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c6c8c94f-ec21-4e3d-ab84-f461daa4dc05 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:29.832464 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c6c8c94f-ec21-4e3d-ab84-f461daa4dc05 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:29.832898 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c6c8c94f-ec21-4e3d-ab84-f461daa4dc05 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:29.985007 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c6c8c94f-ec21-4e3d-ab84-f461daa4dc05 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:29.998855 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c6c8c94f-ec21-4e3d-ab84-f461daa4dc05 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:30.001285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c6c8c94f-ec21-4e3d-ab84-f461daa4dc05 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:30.003693 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c6c8c94f-ec21-4e3d-ab84-f461daa4dc05 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.185208 Jun 16 18:10:30.004521 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 222/447] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:29 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:30.352016 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9083da42-b554-4617-bf7c-31b4b4a56a7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:30.354131 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9083da42-b554-4617-bf7c-31b4b4a56a7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:30.359501 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9083da42-b554-4617-bf7c-31b4b4a56a7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:30.359914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0078cde9-f090-4f2c-afdd-851050730152 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:30.362283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9083da42-b554-4617-bf7c-31b4b4a56a7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:30.362414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0078cde9-f090-4f2c-afdd-851050730152 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:30.362528 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9083da42-b554-4617-bf7c-31b4b4a56a7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:30.362528 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9083da42-b554-4617-bf7c-31b4b4a56a7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:30.368278 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0078cde9-f090-4f2c-afdd-851050730152 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:30.368752 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0078cde9-f090-4f2c-afdd-851050730152 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:30.369518 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0078cde9-f090-4f2c-afdd-851050730152 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:30.369948 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0078cde9-f090-4f2c-afdd-851050730152 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:30.381206 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=100 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:30.573193 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9083da42-b554-4617-bf7c-31b4b4a56a7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:30.579832 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0078cde9-f090-4f2c-afdd-851050730152 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:30.582086 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9083da42-b554-4617-bf7c-31b4b4a56a7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.233934 Jun 16 18:10:30.582672 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 226/448] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:30 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:30.588362 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0078cde9-f090-4f2c-afdd-851050730152 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.232905 Jun 16 18:10:30.588923 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 223/449] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:30 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:30.646633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1bb75b41-14b3-4752-8033-0ace7b1cdafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:30.647233 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1bb75b41-14b3-4752-8033-0ace7b1cdafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:30.654149 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1bb75b41-14b3-4752-8033-0ace7b1cdafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:30.654792 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1bb75b41-14b3-4752-8033-0ace7b1cdafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:30.655706 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1bb75b41-14b3-4752-8033-0ace7b1cdafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:30.656139 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1bb75b41-14b3-4752-8033-0ace7b1cdafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:30.800583 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1bb75b41-14b3-4752-8033-0ace7b1cdafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:30.808530 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1bb75b41-14b3-4752-8033-0ace7b1cdafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.166275 Jun 16 18:10:30.809114 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 227/450] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:30 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:31.024456 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e52da597-005c-4047-ba40-c9bd39ea66be tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:31.025161 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e52da597-005c-4047-ba40-c9bd39ea66be tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:31.031701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e52da597-005c-4047-ba40-c9bd39ea66be tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:31.037623 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e52da597-005c-4047-ba40-c9bd39ea66be tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:31.037623 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e52da597-005c-4047-ba40-c9bd39ea66be tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:31.037623 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e52da597-005c-4047-ba40-c9bd39ea66be tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:31.180282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e52da597-005c-4047-ba40-c9bd39ea66be tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:31.189383 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e52da597-005c-4047-ba40-c9bd39ea66be tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:31.192221 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e52da597-005c-4047-ba40-c9bd39ea66be tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:31.193389 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e52da597-005c-4047-ba40-c9bd39ea66be tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.173082 Jun 16 18:10:31.193943 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 224/451] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:31 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:31.599820 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2dc19b70-6147-40d2-b1a1-9f6784871cf5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:31.600433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2dc19b70-6147-40d2-b1a1-9f6784871cf5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:31.607601 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-820e1419-cb0c-4826-aa74-7446a278de86 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:31.608365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-820e1419-cb0c-4826-aa74-7446a278de86 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:31.608522 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2dc19b70-6147-40d2-b1a1-9f6784871cf5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:31.609784 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2dc19b70-6147-40d2-b1a1-9f6784871cf5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:31.610578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2dc19b70-6147-40d2-b1a1-9f6784871cf5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:31.611013 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2dc19b70-6147-40d2-b1a1-9f6784871cf5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:31.616988 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-820e1419-cb0c-4826-aa74-7446a278de86 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:31.617488 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-820e1419-cb0c-4826-aa74-7446a278de86 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:31.618272 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-820e1419-cb0c-4826-aa74-7446a278de86 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:31.618708 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-820e1419-cb0c-4826-aa74-7446a278de86 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:31.825609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2dc19b70-6147-40d2-b1a1-9f6784871cf5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:31.835053 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2dc19b70-6147-40d2-b1a1-9f6784871cf5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.239623 Jun 16 18:10:31.835272 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-820e1419-cb0c-4826-aa74-7446a278de86 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:31.835703 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 228/452] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:31 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:31.840440 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-bd738ea9-94c0-4bb1-9804-1d01968b04e3 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:31.841501 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-bd738ea9-94c0-4bb1-9804-1d01968b04e3 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:31.843662 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-820e1419-cb0c-4826-aa74-7446a278de86 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.241154 Jun 16 18:10:31.844426 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 225/453] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:31 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:31.850202 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bd738ea9-94c0-4bb1-9804-1d01968b04e3 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:31.850930 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bd738ea9-94c0-4bb1-9804-1d01968b04e3 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:31.853267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bd738ea9-94c0-4bb1-9804-1d01968b04e3 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:31.853267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bd738ea9-94c0-4bb1-9804-1d01968b04e3 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:31.999272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-bd738ea9-94c0-4bb1-9804-1d01968b04e3 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:32.007204 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-bd738ea9-94c0-4bb1-9804-1d01968b04e3 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.170524 Jun 16 18:10:32.007812 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 229/454] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:31 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:32.214378 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5ebfefc9-953f-4233-8eb3-5c7c1cebc066 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:32.215133 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5ebfefc9-953f-4233-8eb3-5c7c1cebc066 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:32.223951 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5ebfefc9-953f-4233-8eb3-5c7c1cebc066 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:32.224454 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5ebfefc9-953f-4233-8eb3-5c7c1cebc066 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:32.225421 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5ebfefc9-953f-4233-8eb3-5c7c1cebc066 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:32.226020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5ebfefc9-953f-4233-8eb3-5c7c1cebc066 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:32.386750 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5ebfefc9-953f-4233-8eb3-5c7c1cebc066 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:32.396650 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5ebfefc9-953f-4233-8eb3-5c7c1cebc066 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:32.398490 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5ebfefc9-953f-4233-8eb3-5c7c1cebc066 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:32.400245 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5ebfefc9-953f-4233-8eb3-5c7c1cebc066 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.190573 Jun 16 18:10:32.401230 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 226/455] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:32 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:10:32.854811 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-879daac5-032c-4825-9f6d-4c36a8f70dd4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:32.855455 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-879daac5-032c-4825-9f6d-4c36a8f70dd4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:32.861857 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1a0a85e9-337a-4ef0-9196-66f42b02c7b2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:32.862531 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-879daac5-032c-4825-9f6d-4c36a8f70dd4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:32.862636 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-879daac5-032c-4825-9f6d-4c36a8f70dd4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:32.863098 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1a0a85e9-337a-4ef0-9196-66f42b02c7b2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:32.863383 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-879daac5-032c-4825-9f6d-4c36a8f70dd4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:32.863829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-879daac5-032c-4825-9f6d-4c36a8f70dd4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:32.869687 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1a0a85e9-337a-4ef0-9196-66f42b02c7b2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:32.870189 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1a0a85e9-337a-4ef0-9196-66f42b02c7b2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:32.870880 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1a0a85e9-337a-4ef0-9196-66f42b02c7b2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:32.871310 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1a0a85e9-337a-4ef0-9196-66f42b02c7b2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:33.014427 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=4 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:33.062382 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-879daac5-032c-4825-9f6d-4c36a8f70dd4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:33.071241 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1a0a85e9-337a-4ef0-9196-66f42b02c7b2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:33.072156 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-879daac5-032c-4825-9f6d-4c36a8f70dd4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.221126 Jun 16 18:10:33.072736 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 230/456] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:32 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:33.077298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c98787c6-b943-4cad-8e1c-31bbcd55fde8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:33.077898 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c98787c6-b943-4cad-8e1c-31bbcd55fde8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:33.079042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1a0a85e9-337a-4ef0-9196-66f42b02c7b2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.221262 Jun 16 18:10:33.079642 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 227/457] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:32 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:33.084666 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c98787c6-b943-4cad-8e1c-31bbcd55fde8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:33.085209 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c98787c6-b943-4cad-8e1c-31bbcd55fde8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:33.085972 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c98787c6-b943-4cad-8e1c-31bbcd55fde8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:33.086406 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c98787c6-b943-4cad-8e1c-31bbcd55fde8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:33.230437 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c98787c6-b943-4cad-8e1c-31bbcd55fde8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:33.239055 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c98787c6-b943-4cad-8e1c-31bbcd55fde8 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.165332 Jun 16 18:10:33.239663 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 231/458] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:33 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:33.423701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0f704a6b-c3b5-421a-b16b-7833912fdecb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:33.424866 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0f704a6b-c3b5-421a-b16b-7833912fdecb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:33.431148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0f704a6b-c3b5-421a-b16b-7833912fdecb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:33.431629 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0f704a6b-c3b5-421a-b16b-7833912fdecb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:33.432401 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0f704a6b-c3b5-421a-b16b-7833912fdecb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:33.432865 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0f704a6b-c3b5-421a-b16b-7833912fdecb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:33.573576 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0f704a6b-c3b5-421a-b16b-7833912fdecb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:33.582397 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0f704a6b-c3b5-421a-b16b-7833912fdecb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:33.584014 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0f704a6b-c3b5-421a-b16b-7833912fdecb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:33.585162 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0f704a6b-c3b5-421a-b16b-7833912fdecb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.165639 Jun 16 18:10:33.585822 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 228/459] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:33 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:34.089416 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e5e4b283-13a0-4ee6-b2d5-f5fa6d726747 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:34.090030 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e5e4b283-13a0-4ee6-b2d5-f5fa6d726747 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:34.092283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=18 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:34.096002 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-979d0ed4-2042-4c8c-b8c9-6787ba4c75cc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:34.098951 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e5e4b283-13a0-4ee6-b2d5-f5fa6d726747 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:34.099310 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-979d0ed4-2042-4c8c-b8c9-6787ba4c75cc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:34.099714 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e5e4b283-13a0-4ee6-b2d5-f5fa6d726747 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:34.100996 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e5e4b283-13a0-4ee6-b2d5-f5fa6d726747 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:34.101699 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e5e4b283-13a0-4ee6-b2d5-f5fa6d726747 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:34.109406 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-979d0ed4-2042-4c8c-b8c9-6787ba4c75cc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:34.117126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-979d0ed4-2042-4c8c-b8c9-6787ba4c75cc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:34.117126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-979d0ed4-2042-4c8c-b8c9-6787ba4c75cc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:34.117126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-979d0ed4-2042-4c8c-b8c9-6787ba4c75cc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:34.327702 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e5e4b283-13a0-4ee6-b2d5-f5fa6d726747 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:34.329213 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-979d0ed4-2042-4c8c-b8c9-6787ba4c75cc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:34.337208 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e5e4b283-13a0-4ee6-b2d5-f5fa6d726747 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.252040 Jun 16 18:10:34.338036 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 232/460] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:34 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:34.343064 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e2793e47-35e6-4dfa-90bb-e7aa8d526cc2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:34.343698 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e2793e47-35e6-4dfa-90bb-e7aa8d526cc2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:34.345785 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:34.348690 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-979d0ed4-2042-4c8c-b8c9-6787ba4c75cc tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.246488 Jun 16 18:10:34.349519 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 229/461] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:34 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:34.354943 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e2793e47-35e6-4dfa-90bb-e7aa8d526cc2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:34.355414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e2793e47-35e6-4dfa-90bb-e7aa8d526cc2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:34.356184 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e2793e47-35e6-4dfa-90bb-e7aa8d526cc2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:34.356614 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e2793e47-35e6-4dfa-90bb-e7aa8d526cc2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:34.507962 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e2793e47-35e6-4dfa-90bb-e7aa8d526cc2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:34.515871 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e2793e47-35e6-4dfa-90bb-e7aa8d526cc2 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.176618 Jun 16 18:10:34.516441 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 233/462] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:34 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:34.604040 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f5b0413a-70cc-44da-92b9-aee64bc9cf09 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:34.604575 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f5b0413a-70cc-44da-92b9-aee64bc9cf09 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:34.611026 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f5b0413a-70cc-44da-92b9-aee64bc9cf09 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:34.611510 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f5b0413a-70cc-44da-92b9-aee64bc9cf09 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:34.612653 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f5b0413a-70cc-44da-92b9-aee64bc9cf09 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:34.612867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f5b0413a-70cc-44da-92b9-aee64bc9cf09 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:34.751773 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f5b0413a-70cc-44da-92b9-aee64bc9cf09 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:34.761706 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f5b0413a-70cc-44da-92b9-aee64bc9cf09 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:34.763201 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f5b0413a-70cc-44da-92b9-aee64bc9cf09 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:34.764415 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f5b0413a-70cc-44da-92b9-aee64bc9cf09 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.164467 Jun 16 18:10:34.764959 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 230/463] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:34 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:35.357985 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-62c71859-0215-4083-a97e-e8cd04a7047d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:35.357985 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-62c71859-0215-4083-a97e-e8cd04a7047d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:35.366440 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-62c71859-0215-4083-a97e-e8cd04a7047d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:35.366884 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-62c71859-0215-4083-a97e-e8cd04a7047d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:35.367687 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-62c71859-0215-4083-a97e-e8cd04a7047d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:35.368117 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-62c71859-0215-4083-a97e-e8cd04a7047d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:35.373259 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9855d6ac-7653-4340-bd08-59b31bf2c727 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:35.374537 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9855d6ac-7653-4340-bd08-59b31bf2c727 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:35.387457 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9855d6ac-7653-4340-bd08-59b31bf2c727 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:35.388224 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9855d6ac-7653-4340-bd08-59b31bf2c727 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:35.389528 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9855d6ac-7653-4340-bd08-59b31bf2c727 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:35.390257 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9855d6ac-7653-4340-bd08-59b31bf2c727 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:35.595438 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-62c71859-0215-4083-a97e-e8cd04a7047d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:35.603787 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9855d6ac-7653-4340-bd08-59b31bf2c727 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:35.604868 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-62c71859-0215-4083-a97e-e8cd04a7047d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.252499 Jun 16 18:10:35.605450 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 234/464] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:35 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:35.615598 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d59f1dea-df79-4a9f-ba55-7e7f80c1d388 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:35.615598 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d59f1dea-df79-4a9f-ba55-7e7f80c1d388 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:35.615835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9855d6ac-7653-4340-bd08-59b31bf2c727 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.242813 Jun 16 18:10:35.617733 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d59f1dea-df79-4a9f-ba55-7e7f80c1d388 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:35.618180 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d59f1dea-df79-4a9f-ba55-7e7f80c1d388 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:35.618954 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d59f1dea-df79-4a9f-ba55-7e7f80c1d388 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:35.619419 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d59f1dea-df79-4a9f-ba55-7e7f80c1d388 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:35.619717 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 231/465] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:35 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:35.753929 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d59f1dea-df79-4a9f-ba55-7e7f80c1d388 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:35.762474 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d59f1dea-df79-4a9f-ba55-7e7f80c1d388 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.156020 Jun 16 18:10:35.763231 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 235/466] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:35 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:35.783444 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-cf30a075-83a7-44c1-96d9-4ae6019a4b48 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:35.784591 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-cf30a075-83a7-44c1-96d9-4ae6019a4b48 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:35.790966 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cf30a075-83a7-44c1-96d9-4ae6019a4b48 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:35.791442 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cf30a075-83a7-44c1-96d9-4ae6019a4b48 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:35.792235 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cf30a075-83a7-44c1-96d9-4ae6019a4b48 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:35.792715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cf30a075-83a7-44c1-96d9-4ae6019a4b48 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:35.929545 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-cf30a075-83a7-44c1-96d9-4ae6019a4b48 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:35.937817 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-cf30a075-83a7-44c1-96d9-4ae6019a4b48 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:35.939350 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-cf30a075-83a7-44c1-96d9-4ae6019a4b48 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:35.940570 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-cf30a075-83a7-44c1-96d9-4ae6019a4b48 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.161136 Jun 16 18:10:35.941125 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 232/467] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:35 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:36.623055 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-22ea8250-56bb-4515-8f4d-d259c3ec3159 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:36.623809 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-22ea8250-56bb-4515-8f4d-d259c3ec3159 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:36.628879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b1715fef-57cf-40cf-a6a4-f5de194edb79 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:36.629623 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b1715fef-57cf-40cf-a6a4-f5de194edb79 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:36.630768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-22ea8250-56bb-4515-8f4d-d259c3ec3159 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:36.631294 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-22ea8250-56bb-4515-8f4d-d259c3ec3159 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:36.632022 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-22ea8250-56bb-4515-8f4d-d259c3ec3159 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:36.632584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-22ea8250-56bb-4515-8f4d-d259c3ec3159 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:36.635923 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b1715fef-57cf-40cf-a6a4-f5de194edb79 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:36.636369 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b1715fef-57cf-40cf-a6a4-f5de194edb79 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:36.637281 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b1715fef-57cf-40cf-a6a4-f5de194edb79 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:36.637690 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b1715fef-57cf-40cf-a6a4-f5de194edb79 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:36.832144 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-22ea8250-56bb-4515-8f4d-d259c3ec3159 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:36.839325 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b1715fef-57cf-40cf-a6a4-f5de194edb79 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:36.840569 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-22ea8250-56bb-4515-8f4d-d259c3ec3159 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.221356 Jun 16 18:10:36.841140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 236/468] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:36 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:36.845810 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ae9389e7-939a-4ced-a861-3cb6753412d6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:36.846617 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ae9389e7-939a-4ced-a861-3cb6753412d6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:36.848033 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b1715fef-57cf-40cf-a6a4-f5de194edb79 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.223009 Jun 16 18:10:36.849438 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 233/469] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:36 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:36.853445 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ae9389e7-939a-4ced-a861-3cb6753412d6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:36.853965 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ae9389e7-939a-4ced-a861-3cb6753412d6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:36.854812 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ae9389e7-939a-4ced-a861-3cb6753412d6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:36.855321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ae9389e7-939a-4ced-a861-3cb6753412d6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:36.958961 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9d90c9c8-c9a7-4fe8-b314-3a9cc61b0ded tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:36.959605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9d90c9c8-c9a7-4fe8-b314-3a9cc61b0ded tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:36.965727 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9d90c9c8-c9a7-4fe8-b314-3a9cc61b0ded tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:36.966173 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9d90c9c8-c9a7-4fe8-b314-3a9cc61b0ded tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:36.967052 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9d90c9c8-c9a7-4fe8-b314-3a9cc61b0ded tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:36.967592 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9d90c9c8-c9a7-4fe8-b314-3a9cc61b0ded tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:36.991938 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ae9389e7-939a-4ced-a861-3cb6753412d6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:36.999532 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ae9389e7-939a-4ced-a861-3cb6753412d6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.157245 Jun 16 18:10:37.000093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 237/470] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:36 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:37.102615 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9d90c9c8-c9a7-4fe8-b314-3a9cc61b0ded tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:37.110544 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9d90c9c8-c9a7-4fe8-b314-3a9cc61b0ded tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:37.112071 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9d90c9c8-c9a7-4fe8-b314-3a9cc61b0ded tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:37.113204 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9d90c9c8-c9a7-4fe8-b314-3a9cc61b0ded tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.159052 Jun 16 18:10:37.113877 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 234/471] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:36 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:10:37.858331 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-fe6ac8c3-b8d2-44f0-a2ec-4523e8779b31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:37.858961 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-fe6ac8c3-b8d2-44f0-a2ec-4523e8779b31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:37.866650 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fe6ac8c3-b8d2-44f0-a2ec-4523e8779b31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:37.867115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fe6ac8c3-b8d2-44f0-a2ec-4523e8779b31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:37.867231 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-be6966f6-a0a9-499d-8e2b-098e497fe5cf tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:37.867862 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-be6966f6-a0a9-499d-8e2b-098e497fe5cf tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:37.867967 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fe6ac8c3-b8d2-44f0-a2ec-4523e8779b31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:37.868374 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fe6ac8c3-b8d2-44f0-a2ec-4523e8779b31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:37.873960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-be6966f6-a0a9-499d-8e2b-098e497fe5cf tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:37.874392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-be6966f6-a0a9-499d-8e2b-098e497fe5cf tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:37.875229 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-be6966f6-a0a9-499d-8e2b-098e497fe5cf tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:37.875682 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-be6966f6-a0a9-499d-8e2b-098e497fe5cf tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:37.880160 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=100 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:38.075988 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-fe6ac8c3-b8d2-44f0-a2ec-4523e8779b31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:38.079140 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-be6966f6-a0a9-499d-8e2b-098e497fe5cf tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:38.085103 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-fe6ac8c3-b8d2-44f0-a2ec-4523e8779b31 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.230608 Jun 16 18:10:38.085772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 238/472] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:37 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:38.087838 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-be6966f6-a0a9-499d-8e2b-098e497fe5cf tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.225820 Jun 16 18:10:38.088697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 235/473] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:37 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:38.090469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-20c0b6c1-a162-4206-857b-66c745ccb1cc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:38.091167 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-20c0b6c1-a162-4206-857b-66c745ccb1cc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:38.097343 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-20c0b6c1-a162-4206-857b-66c745ccb1cc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:38.097804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-20c0b6c1-a162-4206-857b-66c745ccb1cc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:38.099149 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-20c0b6c1-a162-4206-857b-66c745ccb1cc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:38.099786 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-20c0b6c1-a162-4206-857b-66c745ccb1cc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:38.132738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-07d9fb99-5f25-466e-9ae2-96dd29fa1efd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:38.133248 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-07d9fb99-5f25-466e-9ae2-96dd29fa1efd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:38.141885 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07d9fb99-5f25-466e-9ae2-96dd29fa1efd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:38.142773 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07d9fb99-5f25-466e-9ae2-96dd29fa1efd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:38.144286 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07d9fb99-5f25-466e-9ae2-96dd29fa1efd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:38.145145 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07d9fb99-5f25-466e-9ae2-96dd29fa1efd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:38.310398 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-20c0b6c1-a162-4206-857b-66c745ccb1cc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:38.318882 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-20c0b6c1-a162-4206-857b-66c745ccb1cc tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.231703 Jun 16 18:10:38.319944 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 239/474] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:38 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:38.338932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-07d9fb99-5f25-466e-9ae2-96dd29fa1efd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:38.347352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-07d9fb99-5f25-466e-9ae2-96dd29fa1efd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:38.348989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-07d9fb99-5f25-466e-9ae2-96dd29fa1efd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:38.350280 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-07d9fb99-5f25-466e-9ae2-96dd29fa1efd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.221910 Jun 16 18:10:38.350832 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 236/475] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:38 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:10:39.106747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c560f572-896b-48f6-bac0-8da589cf6924 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:39.107973 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c560f572-896b-48f6-bac0-8da589cf6924 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:39.108579 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-08d3a9e7-960c-4966-9756-3c850bd72a0f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:39.109602 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-08d3a9e7-960c-4966-9756-3c850bd72a0f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:39.119357 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c560f572-896b-48f6-bac0-8da589cf6924 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:39.127901 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c560f572-896b-48f6-bac0-8da589cf6924 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:39.127901 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c560f572-896b-48f6-bac0-8da589cf6924 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:39.127901 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c560f572-896b-48f6-bac0-8da589cf6924 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:39.128195 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-08d3a9e7-960c-4966-9756-3c850bd72a0f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:39.128195 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-08d3a9e7-960c-4966-9756-3c850bd72a0f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:39.128195 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-08d3a9e7-960c-4966-9756-3c850bd72a0f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:39.128195 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-08d3a9e7-960c-4966-9756-3c850bd72a0f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:39.582467 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-08d3a9e7-960c-4966-9756-3c850bd72a0f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:39.586515 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c560f572-896b-48f6-bac0-8da589cf6924 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:39.591139 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-08d3a9e7-960c-4966-9756-3c850bd72a0f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.488932 Jun 16 18:10:39.592038 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 237/476] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:39 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:39.596411 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c560f572-896b-48f6-bac0-8da589cf6924 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.496389 Jun 16 18:10:39.596567 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7e982514-1767-4d35-8d43-52c659b50744 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:39.599444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 240/477] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:39 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:39.600212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7e982514-1767-4d35-8d43-52c659b50744 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:39.606107 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0ad4598c-24d8-4959-a053-beec4b7117e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:39.607139 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0ad4598c-24d8-4959-a053-beec4b7117e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:39.609412 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7e982514-1767-4d35-8d43-52c659b50744 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:39.610188 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7e982514-1767-4d35-8d43-52c659b50744 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:39.611354 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7e982514-1767-4d35-8d43-52c659b50744 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:39.612136 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7e982514-1767-4d35-8d43-52c659b50744 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:39.617424 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ad4598c-24d8-4959-a053-beec4b7117e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:39.618155 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ad4598c-24d8-4959-a053-beec4b7117e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:39.619423 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ad4598c-24d8-4959-a053-beec4b7117e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:39.620100 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ad4598c-24d8-4959-a053-beec4b7117e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:39.835408 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0ad4598c-24d8-4959-a053-beec4b7117e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:39.839359 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7e982514-1767-4d35-8d43-52c659b50744 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:39.843818 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0ad4598c-24d8-4959-a053-beec4b7117e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:39.845342 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0ad4598c-24d8-4959-a053-beec4b7117e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:39.846506 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0ad4598c-24d8-4959-a053-beec4b7117e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.248623 Jun 16 18:10:39.847065 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 241/478] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:39 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:39.847554 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7e982514-1767-4d35-8d43-52c659b50744 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.254643 Jun 16 18:10:39.848108 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 238/479] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:39 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:40.610750 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-47e2b45c-e5b5-4750-af9f-4a0c92236f6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:40.611291 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-47e2b45c-e5b5-4750-af9f-4a0c92236f6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:40.619198 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3daa05c5-76eb-4190-9396-fc8607aacc17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:40.620434 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3daa05c5-76eb-4190-9396-fc8607aacc17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:40.623574 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:40.623849 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-47e2b45c-e5b5-4750-af9f-4a0c92236f6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:40.624215 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-47e2b45c-e5b5-4750-af9f-4a0c92236f6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:40.624884 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-47e2b45c-e5b5-4750-af9f-4a0c92236f6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:40.625326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-47e2b45c-e5b5-4750-af9f-4a0c92236f6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:40.633850 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3daa05c5-76eb-4190-9396-fc8607aacc17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:40.634853 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3daa05c5-76eb-4190-9396-fc8607aacc17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:40.641901 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3daa05c5-76eb-4190-9396-fc8607aacc17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:40.641901 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3daa05c5-76eb-4190-9396-fc8607aacc17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:40.838794 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-47e2b45c-e5b5-4750-af9f-4a0c92236f6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:40.842244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3daa05c5-76eb-4190-9396-fc8607aacc17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:40.846718 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-47e2b45c-e5b5-4750-af9f-4a0c92236f6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.240378 Jun 16 18:10:40.847385 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 242/480] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:40 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:40.851096 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3daa05c5-76eb-4190-9396-fc8607aacc17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.238296 Jun 16 18:10:40.851779 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 239/481] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:40 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:40.868936 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b8641e0e-a29b-4300-9e52-a12d44615356 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:40.868936 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b8641e0e-a29b-4300-9e52-a12d44615356 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:40.869227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-cfaea475-e1fe-4e2e-886c-4ebd2e8a4537 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:40.869227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-cfaea475-e1fe-4e2e-886c-4ebd2e8a4537 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:40.872121 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8641e0e-a29b-4300-9e52-a12d44615356 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:40.872573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8641e0e-a29b-4300-9e52-a12d44615356 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:40.873352 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8641e0e-a29b-4300-9e52-a12d44615356 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:40.873691 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cfaea475-e1fe-4e2e-886c-4ebd2e8a4537 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:40.873803 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8641e0e-a29b-4300-9e52-a12d44615356 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:40.874138 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cfaea475-e1fe-4e2e-886c-4ebd2e8a4537 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:40.874936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cfaea475-e1fe-4e2e-886c-4ebd2e8a4537 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:40.875401 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cfaea475-e1fe-4e2e-886c-4ebd2e8a4537 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:40.878724 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=100 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:41.082052 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-cfaea475-e1fe-4e2e-886c-4ebd2e8a4537 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:41.087399 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b8641e0e-a29b-4300-9e52-a12d44615356 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:41.092518 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-cfaea475-e1fe-4e2e-886c-4ebd2e8a4537 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:41.094250 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-cfaea475-e1fe-4e2e-886c-4ebd2e8a4537 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:41.094879 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b8641e0e-a29b-4300-9e52-a12d44615356 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.234382 Jun 16 18:10:41.103419 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-cfaea475-e1fe-4e2e-886c-4ebd2e8a4537 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.233682 Jun 16 18:10:41.103601 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 243/482] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:40 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:41.103715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 240/483] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:40 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:41.864428 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-62406252-e07e-4282-ba9c-4a450ad17f8c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:41.865776 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-62406252-e07e-4282-ba9c-4a450ad17f8c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:41.869111 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-32891152-b6f9-4ca1-9445-4a3fb493cb23 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:41.869729 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-32891152-b6f9-4ca1-9445-4a3fb493cb23 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:41.872624 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-62406252-e07e-4282-ba9c-4a450ad17f8c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:41.872961 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-62406252-e07e-4282-ba9c-4a450ad17f8c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:41.873726 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-62406252-e07e-4282-ba9c-4a450ad17f8c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:41.874164 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-62406252-e07e-4282-ba9c-4a450ad17f8c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:41.875981 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-32891152-b6f9-4ca1-9445-4a3fb493cb23 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:41.876432 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-32891152-b6f9-4ca1-9445-4a3fb493cb23 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:41.877207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-32891152-b6f9-4ca1-9445-4a3fb493cb23 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:41.877642 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-32891152-b6f9-4ca1-9445-4a3fb493cb23 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:42.076821 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-62406252-e07e-4282-ba9c-4a450ad17f8c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:42.085500 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-32891152-b6f9-4ca1-9445-4a3fb493cb23 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:42.085690 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-62406252-e07e-4282-ba9c-4a450ad17f8c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.225289 Jun 16 18:10:42.086236 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 244/484] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:41 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:42.093897 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-32891152-b6f9-4ca1-9445-4a3fb493cb23 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.229193 Jun 16 18:10:42.094751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 241/485] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:41 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:42.111818 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-649250f4-6b00-4ab3-b6e2-dfe91a2b1285 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:42.112435 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-649250f4-6b00-4ab3-b6e2-dfe91a2b1285 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:42.115202 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-bf441414-afb2-4bcd-b855-b73d315aff6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:42.115759 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-bf441414-afb2-4bcd-b855-b73d315aff6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:42.118665 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-649250f4-6b00-4ab3-b6e2-dfe91a2b1285 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:42.119106 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-649250f4-6b00-4ab3-b6e2-dfe91a2b1285 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:42.119901 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-649250f4-6b00-4ab3-b6e2-dfe91a2b1285 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:42.120386 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-649250f4-6b00-4ab3-b6e2-dfe91a2b1285 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:42.121709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bf441414-afb2-4bcd-b855-b73d315aff6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:42.122149 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bf441414-afb2-4bcd-b855-b73d315aff6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:42.122911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bf441414-afb2-4bcd-b855-b73d315aff6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:42.123342 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bf441414-afb2-4bcd-b855-b73d315aff6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:42.331909 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-649250f4-6b00-4ab3-b6e2-dfe91a2b1285 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:42.336859 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-bf441414-afb2-4bcd-b855-b73d315aff6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:42.341036 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-649250f4-6b00-4ab3-b6e2-dfe91a2b1285 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.232976 Jun 16 18:10:42.341919 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 245/486] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:42 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:42.345675 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-bf441414-afb2-4bcd-b855-b73d315aff6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:42.347274 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-bf441414-afb2-4bcd-b855-b73d315aff6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:42.348475 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-bf441414-afb2-4bcd-b855-b73d315aff6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1744 microversion: 2.20 time: 0.237431 Jun 16 18:10:42.349738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 242/487] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:42 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1744 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:42.578684 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-e7753366-639d-4e21-bd3a-cc31e1e8f5d8 req-f7421506-f531-4a56-9e56-09c3b8469c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a820253-c5ce-455d-9bf7-ded303efc37c", "name": "network-vif-plugged", "status": "completed", "tag": "e95f3b78-5899-46e2-9295-d2c2a36592f2"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:42.587087 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-e7753366-639d-4e21-bd3a-cc31e1e8f5d8 req-f7421506-f531-4a56-9e56-09c3b8469c1f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:42.587599 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-e7753366-639d-4e21-bd3a-cc31e1e8f5d8 req-f7421506-f531-4a56-9e56-09c3b8469c1f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:42.600143 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-e7753366-639d-4e21-bd3a-cc31e1e8f5d8 req-f7421506-f531-4a56-9e56-09c3b8469c1f service nova] Creating event network-vif-plugged:e95f3b78-5899-46e2-9295-d2c2a36592f2 for instance 3a820253-c5ce-455d-9bf7-ded303efc37c on hv-cinder-83754 Jun 16 18:10:42.605535 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-e7753366-639d-4e21-bd3a-cc31e1e8f5d8 req-f7421506-f531-4a56-9e56-09c3b8469c1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030665 Jun 16 18:10:42.606433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 246/488] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:10:43.102369 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d02ac959-7ec3-4435-9b0b-328e52a5f76a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:43.103026 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d02ac959-7ec3-4435-9b0b-328e52a5f76a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:43.111006 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d02ac959-7ec3-4435-9b0b-328e52a5f76a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:43.111577 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d02ac959-7ec3-4435-9b0b-328e52a5f76a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:43.112428 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d02ac959-7ec3-4435-9b0b-328e52a5f76a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:43.112655 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9d64e2d1-c742-425f-868d-c433284b6230 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:43.113118 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d02ac959-7ec3-4435-9b0b-328e52a5f76a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:43.113712 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9d64e2d1-c742-425f-868d-c433284b6230 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:43.122058 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9d64e2d1-c742-425f-868d-c433284b6230 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:43.122592 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9d64e2d1-c742-425f-868d-c433284b6230 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:43.123614 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9d64e2d1-c742-425f-868d-c433284b6230 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:43.124232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9d64e2d1-c742-425f-868d-c433284b6230 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:43.318032 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d02ac959-7ec3-4435-9b0b-328e52a5f76a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:43.322234 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9d64e2d1-c742-425f-868d-c433284b6230 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:43.326621 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d02ac959-7ec3-4435-9b0b-328e52a5f76a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.228480 Jun 16 18:10:43.327180 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 243/489] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:43 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:43.337560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9d64e2d1-c742-425f-868d-c433284b6230 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.222934 Jun 16 18:10:43.337560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 247/490] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:43 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:43.357927 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-fb7aaa61-d46c-4faf-8122-26994f3399c1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:43.358523 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-fb7aaa61-d46c-4faf-8122-26994f3399c1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:43.365612 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fb7aaa61-d46c-4faf-8122-26994f3399c1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:43.366054 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fb7aaa61-d46c-4faf-8122-26994f3399c1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:43.366808 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fb7aaa61-d46c-4faf-8122-26994f3399c1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:43.367232 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fb7aaa61-d46c-4faf-8122-26994f3399c1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:43.383562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5e5f1569-fae1-4e78-94d7-557b169d43db tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:43.384191 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5e5f1569-fae1-4e78-94d7-557b169d43db tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:43.390490 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5e5f1569-fae1-4e78-94d7-557b169d43db tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:43.390934 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5e5f1569-fae1-4e78-94d7-557b169d43db tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:43.391798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5e5f1569-fae1-4e78-94d7-557b169d43db tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:43.392277 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5e5f1569-fae1-4e78-94d7-557b169d43db tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:43.577150 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-fb7aaa61-d46c-4faf-8122-26994f3399c1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:43.580688 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5e5f1569-fae1-4e78-94d7-557b169d43db tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:43.585859 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-fb7aaa61-d46c-4faf-8122-26994f3399c1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.231737 Jun 16 18:10:43.586416 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 244/491] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:43 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:43.592619 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5e5f1569-fae1-4e78-94d7-557b169d43db tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:43.595158 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5e5f1569-fae1-4e78-94d7-557b169d43db tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:43.595575 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5e5f1569-fae1-4e78-94d7-557b169d43db tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1744 microversion: 2.20 time: 0.216557 Jun 16 18:10:43.603241 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 248/492] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:43 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:10:44.346720 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f82bca48-dc1b-493e-b0c1-9c5c80ecf2d1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:44.348653 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f82bca48-dc1b-493e-b0c1-9c5c80ecf2d1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:44.353800 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9df9904e-3819-4610-93ef-99f978edd150 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:44.356830 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9df9904e-3819-4610-93ef-99f978edd150 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:44.360493 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f82bca48-dc1b-493e-b0c1-9c5c80ecf2d1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:44.361306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f82bca48-dc1b-493e-b0c1-9c5c80ecf2d1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:44.362861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f82bca48-dc1b-493e-b0c1-9c5c80ecf2d1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:44.363615 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f82bca48-dc1b-493e-b0c1-9c5c80ecf2d1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:44.368613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9df9904e-3819-4610-93ef-99f978edd150 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:44.369344 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9df9904e-3819-4610-93ef-99f978edd150 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:44.370886 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9df9904e-3819-4610-93ef-99f978edd150 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:44.371634 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9df9904e-3819-4610-93ef-99f978edd150 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:44.612430 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f82bca48-dc1b-493e-b0c1-9c5c80ecf2d1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:44.618250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9df9904e-3819-4610-93ef-99f978edd150 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:44.621651 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f82bca48-dc1b-493e-b0c1-9c5c80ecf2d1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.281368 Jun 16 18:10:44.622244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 245/493] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:44 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:44.627412 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ebb9e0b3-ec4a-4db4-8b20-312e40bbf775 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:44.628135 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ebb9e0b3-ec4a-4db4-8b20-312e40bbf775 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:44.634911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ebb9e0b3-ec4a-4db4-8b20-312e40bbf775 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:44.635380 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ebb9e0b3-ec4a-4db4-8b20-312e40bbf775 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:44.636196 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ebb9e0b3-ec4a-4db4-8b20-312e40bbf775 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:44.636630 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ebb9e0b3-ec4a-4db4-8b20-312e40bbf775 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:44.642893 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9df9904e-3819-4610-93ef-99f978edd150 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.297265 Jun 16 18:10:44.643517 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 249/494] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:44 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:44.648832 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-53eccee3-5e87-4372-99e0-88fed0bebf0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:44.649449 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-53eccee3-5e87-4372-99e0-88fed0bebf0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:44.656521 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-53eccee3-5e87-4372-99e0-88fed0bebf0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:44.656521 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-53eccee3-5e87-4372-99e0-88fed0bebf0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:44.657305 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-53eccee3-5e87-4372-99e0-88fed0bebf0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:44.657915 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-53eccee3-5e87-4372-99e0-88fed0bebf0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:44.855885 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ebb9e0b3-ec4a-4db4-8b20-312e40bbf775 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:44.862723 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-53eccee3-5e87-4372-99e0-88fed0bebf0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:44.863313 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ebb9e0b3-ec4a-4db4-8b20-312e40bbf775 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.240041 Jun 16 18:10:44.863913 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 246/495] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:44 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:44.869830 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-62f9452d-2e5a-4481-944b-f2dce5253eb8 req-84e9d81b-94b0-4d0f-a4f4-d6588309cb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279175ca-aad1-40da-a191-4712cbd17771", "name": "network-vif-plugged", "status": "completed", "tag": "d3e274fe-5d79-4687-9f75-5a8fd858ef61"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:44.872994 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-53eccee3-5e87-4372-99e0-88fed0bebf0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:44.874883 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-53eccee3-5e87-4372-99e0-88fed0bebf0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:44.876297 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-53eccee3-5e87-4372-99e0-88fed0bebf0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1744 microversion: 2.20 time: 0.231634 Jun 16 18:10:44.877016 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 250/496] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:44 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1744 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:44.877858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-62f9452d-2e5a-4481-944b-f2dce5253eb8 req-84e9d81b-94b0-4d0f-a4f4-d6588309cb4a service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:44.878290 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-62f9452d-2e5a-4481-944b-f2dce5253eb8 req-84e9d81b-94b0-4d0f-a4f4-d6588309cb4a service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:44.890520 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-62f9452d-2e5a-4481-944b-f2dce5253eb8 req-84e9d81b-94b0-4d0f-a4f4-d6588309cb4a service nova] Creating event network-vif-plugged:d3e274fe-5d79-4687-9f75-5a8fd858ef61 for instance 279175ca-aad1-40da-a191-4712cbd17771 on hv-cinder-83754 Jun 16 18:10:44.895651 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-62f9452d-2e5a-4481-944b-f2dce5253eb8 req-84e9d81b-94b0-4d0f-a4f4-d6588309cb4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030619 Jun 16 18:10:44.896757 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 247/497] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:10:45.641631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c9e9e9ec-97b3-4e53-b67d-d25feb19d995 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:45.642249 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c9e9e9ec-97b3-4e53-b67d-d25feb19d995 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:45.652315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c9e9e9ec-97b3-4e53-b67d-d25feb19d995 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:45.654393 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c9e9e9ec-97b3-4e53-b67d-d25feb19d995 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:45.654393 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c9e9e9ec-97b3-4e53-b67d-d25feb19d995 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:45.654597 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c9e9e9ec-97b3-4e53-b67d-d25feb19d995 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:45.663038 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-04b2e4d5-5d20-4d0c-8768-2891c4897b0b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:45.663760 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-04b2e4d5-5d20-4d0c-8768-2891c4897b0b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:45.670716 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-04b2e4d5-5d20-4d0c-8768-2891c4897b0b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:45.671323 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-04b2e4d5-5d20-4d0c-8768-2891c4897b0b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:45.672199 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-04b2e4d5-5d20-4d0c-8768-2891c4897b0b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:45.672617 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-04b2e4d5-5d20-4d0c-8768-2891c4897b0b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:45.866262 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c9e9e9ec-97b3-4e53-b67d-d25feb19d995 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:45.874648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c9e9e9ec-97b3-4e53-b67d-d25feb19d995 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1367 microversion: 2.1 time: 0.237044 Jun 16 18:10:45.875798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 251/498] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:45 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:45.881641 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-201e5e94-6584-4ae3-984a-39faf92bbe37 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:45.882434 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-04b2e4d5-5d20-4d0c-8768-2891c4897b0b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:45.882578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-201e5e94-6584-4ae3-984a-39faf92bbe37 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:45.888663 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-201e5e94-6584-4ae3-984a-39faf92bbe37 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:45.889119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-201e5e94-6584-4ae3-984a-39faf92bbe37 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:45.890044 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-201e5e94-6584-4ae3-984a-39faf92bbe37 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:45.890371 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-201e5e94-6584-4ae3-984a-39faf92bbe37 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:45.890497 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-04b2e4d5-5d20-4d0c-8768-2891c4897b0b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1722 microversion: 2.1 time: 0.232090 Jun 16 18:10:45.891019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 248/499] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:45 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:45.897331 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5f71e5e8-1007-40f8-8d54-2779403c2207 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:45.898330 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5f71e5e8-1007-40f8-8d54-2779403c2207 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:45.904710 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5f71e5e8-1007-40f8-8d54-2779403c2207 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:45.905152 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5f71e5e8-1007-40f8-8d54-2779403c2207 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:45.905914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5f71e5e8-1007-40f8-8d54-2779403c2207 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:45.906344 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5f71e5e8-1007-40f8-8d54-2779403c2207 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:46.117003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-201e5e94-6584-4ae3-984a-39faf92bbe37 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:46.124107 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5f71e5e8-1007-40f8-8d54-2779403c2207 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:46.125823 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-201e5e94-6584-4ae3-984a-39faf92bbe37 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.248867 Jun 16 18:10:46.126388 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 252/500] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:45 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:46.133130 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5f71e5e8-1007-40f8-8d54-2779403c2207 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:46.134756 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5f71e5e8-1007-40f8-8d54-2779403c2207 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:46.136032 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5f71e5e8-1007-40f8-8d54-2779403c2207 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1744 microversion: 2.20 time: 0.243134 Jun 16 18:10:46.136653 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 249/501] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:45 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1744 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:46.892566 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c15696df-899b-4355-9d34-668028553a2d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:46.893187 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c15696df-899b-4355-9d34-668028553a2d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:46.901430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c15696df-899b-4355-9d34-668028553a2d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:46.902059 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c15696df-899b-4355-9d34-668028553a2d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:46.903261 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c15696df-899b-4355-9d34-668028553a2d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:46.903919 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c15696df-899b-4355-9d34-668028553a2d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:46.910329 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7b16e577-30e2-4815-8cb5-82aca1d9f9ab tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:46.911773 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7b16e577-30e2-4815-8cb5-82aca1d9f9ab tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:46.920690 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7b16e577-30e2-4815-8cb5-82aca1d9f9ab tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:46.921408 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7b16e577-30e2-4815-8cb5-82aca1d9f9ab tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:46.922330 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7b16e577-30e2-4815-8cb5-82aca1d9f9ab tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:46.922908 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7b16e577-30e2-4815-8cb5-82aca1d9f9ab tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:47.137732 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7b16e577-30e2-4815-8cb5-82aca1d9f9ab tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:47.141617 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c15696df-899b-4355-9d34-668028553a2d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:47.146330 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7b16e577-30e2-4815-8cb5-82aca1d9f9ab tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1699 microversion: 2.1 time: 0.240778 Jun 16 18:10:47.149021 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 250/502] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:46 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1699 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:47.149867 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c15696df-899b-4355-9d34-668028553a2d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1558 microversion: 2.1 time: 0.261161 Jun 16 18:10:47.150428 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 253/503] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:46 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1558 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:47.152724 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-951c76a5-06c5-4be5-a35c-3d11be3d7ed1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:47.153380 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-951c76a5-06c5-4be5-a35c-3d11be3d7ed1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:47.159261 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-951c76a5-06c5-4be5-a35c-3d11be3d7ed1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:47.159800 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-951c76a5-06c5-4be5-a35c-3d11be3d7ed1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:47.160643 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-951c76a5-06c5-4be5-a35c-3d11be3d7ed1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:47.161128 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-951c76a5-06c5-4be5-a35c-3d11be3d7ed1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:47.167034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-33c99a41-a2f9-422a-aab3-4605c3d3b95c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:47.168019 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-33c99a41-a2f9-422a-aab3-4605c3d3b95c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:47.174849 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33c99a41-a2f9-422a-aab3-4605c3d3b95c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:47.176875 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33c99a41-a2f9-422a-aab3-4605c3d3b95c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:47.176875 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33c99a41-a2f9-422a-aab3-4605c3d3b95c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:47.176875 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33c99a41-a2f9-422a-aab3-4605c3d3b95c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:47.367654 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-951c76a5-06c5-4be5-a35c-3d11be3d7ed1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:47.375539 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-951c76a5-06c5-4be5-a35c-3d11be3d7ed1 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.226565 Jun 16 18:10:47.376391 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 251/504] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:47 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:47.381600 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9f608d81-aca2-46d8-9b57-550a0202ce4a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:47.387417 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-33c99a41-a2f9-422a-aab3-4605c3d3b95c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:47.395624 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f608d81-aca2-46d8-9b57-550a0202ce4a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:47.396004 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f608d81-aca2-46d8-9b57-550a0202ce4a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:47.397681 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-33c99a41-a2f9-422a-aab3-4605c3d3b95c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:47.399758 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-33c99a41-a2f9-422a-aab3-4605c3d3b95c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:47.400973 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-33c99a41-a2f9-422a-aab3-4605c3d3b95c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1744 microversion: 2.20 time: 0.240526 Jun 16 18:10:47.401698 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 254/505] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:47 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1744 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:10:47.408187 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b6639f43-1d38-4a18-8df7-ff1cad75e289 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:47.408966 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b6639f43-1d38-4a18-8df7-ff1cad75e289 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:47.415811 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=100 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:47.419819 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b6639f43-1d38-4a18-8df7-ff1cad75e289 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:47.420422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b6639f43-1d38-4a18-8df7-ff1cad75e289 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:47.421329 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b6639f43-1d38-4a18-8df7-ff1cad75e289 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:47.421867 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b6639f43-1d38-4a18-8df7-ff1cad75e289 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:47.422305 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9f608d81-aca2-46d8-9b57-550a0202ce4a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Going to try to start instance {{(pid=118161) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 18:10:47.519949 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b6639f43-1d38-4a18-8df7-ff1cad75e289 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108367 Jun 16 18:10:47.519949 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 255/506] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jun 16 18:10:47 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:10:47.519949 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-6477f1b9-3f98-4586-861d-72f8ce821f71 req-182f50f4-709c-413e-a091-f8010e31ef6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6c9426-2d6f-4dfb-8bc8-959827d8cf79", "name": "network-vif-plugged", "status": "completed", "tag": "aaf3fae1-693c-4fec-8e06-dc30896dc3f7"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:47.530601 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-6477f1b9-3f98-4586-861d-72f8ce821f71 req-182f50f4-709c-413e-a091-f8010e31ef6f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:47.531045 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-6477f1b9-3f98-4586-861d-72f8ce821f71 req-182f50f4-709c-413e-a091-f8010e31ef6f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:47.545487 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-6477f1b9-3f98-4586-861d-72f8ce821f71 req-182f50f4-709c-413e-a091-f8010e31ef6f service nova] Creating event network-vif-plugged:aaf3fae1-693c-4fec-8e06-dc30896dc3f7 for instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79 on hv-cinder-83754 Jun 16 18:10:47.555049 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-6477f1b9-3f98-4586-861d-72f8ce821f71 req-182f50f4-709c-413e-a091-f8010e31ef6f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039837 Jun 16 18:10:47.555889 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 256/507] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:10:47.765712 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9f608d81-aca2-46d8-9b57-550a0202ce4a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "POST /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/action" status: 202 len: 0 microversion: 2.1 time: 0.387805 Jun 16 18:10:47.766987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 252/508] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:10:47 2022] POST /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:10:47.778578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dcefb925-f510-4910-91b1-a1297e6d6771 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:47.779479 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-dcefb925-f510-4910-91b1-a1297e6d6771 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:47.789958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dcefb925-f510-4910-91b1-a1297e6d6771 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:47.790584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dcefb925-f510-4910-91b1-a1297e6d6771 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:47.800309 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dcefb925-f510-4910-91b1-a1297e6d6771 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:47.801835 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dcefb925-f510-4910-91b1-a1297e6d6771 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:47.956535 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dcefb925-f510-4910-91b1-a1297e6d6771 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:47.963740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-dcefb925-f510-4910-91b1-a1297e6d6771 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1708 microversion: 2.1 time: 0.191566 Jun 16 18:10:47.964475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 257/509] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:47 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1708 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:48.393395 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-dbf522b9-171b-42f0-8bd8-38d547963a22 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:48.394132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-dbf522b9-171b-42f0-8bd8-38d547963a22 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:48.401054 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dbf522b9-171b-42f0-8bd8-38d547963a22 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:48.401499 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dbf522b9-171b-42f0-8bd8-38d547963a22 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:48.402483 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dbf522b9-171b-42f0-8bd8-38d547963a22 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:48.402919 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dbf522b9-171b-42f0-8bd8-38d547963a22 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:48.421235 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-33521618-5ed8-4c0f-ba5f-ee9ef595a057 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:48.421853 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-33521618-5ed8-4c0f-ba5f-ee9ef595a057 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:48.430183 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33521618-5ed8-4c0f-ba5f-ee9ef595a057 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:48.430662 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33521618-5ed8-4c0f-ba5f-ee9ef595a057 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:48.431958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33521618-5ed8-4c0f-ba5f-ee9ef595a057 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:48.432912 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33521618-5ed8-4c0f-ba5f-ee9ef595a057 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:48.610267 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-dbf522b9-171b-42f0-8bd8-38d547963a22 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:48.619100 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-dbf522b9-171b-42f0-8bd8-38d547963a22 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.230540 Jun 16 18:10:48.620100 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 253/510] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:48 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:48.645467 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-33521618-5ed8-4c0f-ba5f-ee9ef595a057 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:48.654571 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-33521618-5ed8-4c0f-ba5f-ee9ef595a057 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:48.656256 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-33521618-5ed8-4c0f-ba5f-ee9ef595a057 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:48.657427 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-33521618-5ed8-4c0f-ba5f-ee9ef595a057 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1744 microversion: 2.20 time: 0.241064 Jun 16 18:10:48.657978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 258/511] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:48 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1744 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:10:48.984503 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-386ee0ac-2987-4b32-a839-4b58c1f1db29 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:48.985106 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-386ee0ac-2987-4b32-a839-4b58c1f1db29 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:48.992303 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-386ee0ac-2987-4b32-a839-4b58c1f1db29 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:48.992749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-386ee0ac-2987-4b32-a839-4b58c1f1db29 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:48.993517 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-386ee0ac-2987-4b32-a839-4b58c1f1db29 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:48.993947 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-386ee0ac-2987-4b32-a839-4b58c1f1db29 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:49.102611 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-8f047bdf-3f9e-4698-b76a-3ae69484206c req-ae535870-9bcf-4678-b02b-a691b47c6a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a820253-c5ce-455d-9bf7-ded303efc37c", "tag": "e95f3b78-5899-46e2-9295-d2c2a36592f2"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:49.112120 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-8f047bdf-3f9e-4698-b76a-3ae69484206c req-ae535870-9bcf-4678-b02b-a691b47c6a4d service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:49.112766 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-8f047bdf-3f9e-4698-b76a-3ae69484206c req-ae535870-9bcf-4678-b02b-a691b47c6a4d service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:49.127405 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-8f047bdf-3f9e-4698-b76a-3ae69484206c req-ae535870-9bcf-4678-b02b-a691b47c6a4d service nova] Creating event network-changed:e95f3b78-5899-46e2-9295-d2c2a36592f2 for instance 3a820253-c5ce-455d-9bf7-ded303efc37c on hv-cinder-83754 Jun 16 18:10:49.133724 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-8f047bdf-3f9e-4698-b76a-3ae69484206c req-ae535870-9bcf-4678-b02b-a691b47c6a4d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034941 Jun 16 18:10:49.134649 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 259/512] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:10:49.156167 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-386ee0ac-2987-4b32-a839-4b58c1f1db29 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:49.165449 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-386ee0ac-2987-4b32-a839-4b58c1f1db29 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1708 microversion: 2.1 time: 0.184696 Jun 16 18:10:49.166021 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 254/513] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:48 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1708 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:49.641657 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8e14a72d-2ebe-4cfc-94c1-eb0fe2b54202 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:49.642714 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8e14a72d-2ebe-4cfc-94c1-eb0fe2b54202 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:49.654968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8e14a72d-2ebe-4cfc-94c1-eb0fe2b54202 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:49.655650 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8e14a72d-2ebe-4cfc-94c1-eb0fe2b54202 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:49.656506 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8e14a72d-2ebe-4cfc-94c1-eb0fe2b54202 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:49.656890 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8e14a72d-2ebe-4cfc-94c1-eb0fe2b54202 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:49.677453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9facfd15-fa70-42d6-adb0-bfd8715f6fa5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:49.679315 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9facfd15-fa70-42d6-adb0-bfd8715f6fa5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:49.690908 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9facfd15-fa70-42d6-adb0-bfd8715f6fa5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:49.691749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9facfd15-fa70-42d6-adb0-bfd8715f6fa5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:49.692832 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9facfd15-fa70-42d6-adb0-bfd8715f6fa5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:49.693483 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9facfd15-fa70-42d6-adb0-bfd8715f6fa5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:49.970442 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8e14a72d-2ebe-4cfc-94c1-eb0fe2b54202 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:49.985659 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9facfd15-fa70-42d6-adb0-bfd8715f6fa5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:49.993024 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8e14a72d-2ebe-4cfc-94c1-eb0fe2b54202 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1259 microversion: 2.1 time: 0.347348 Jun 16 18:10:49.997158 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 260/514] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:49 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1259 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:50.008212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9facfd15-fa70-42d6-adb0-bfd8715f6fa5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:50.010627 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9facfd15-fa70-42d6-adb0-bfd8715f6fa5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:50.012154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9facfd15-fa70-42d6-adb0-bfd8715f6fa5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.338595 Jun 16 18:10:50.027587 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 255/515] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:49 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:50.185455 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0d7ab6e8-0b3c-4ca3-946c-3619c94d5cef tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:50.196873 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0d7ab6e8-0b3c-4ca3-946c-3619c94d5cef tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:50.205404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0d7ab6e8-0b3c-4ca3-946c-3619c94d5cef tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:50.206104 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0d7ab6e8-0b3c-4ca3-946c-3619c94d5cef tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:50.207112 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0d7ab6e8-0b3c-4ca3-946c-3619c94d5cef tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:50.207810 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0d7ab6e8-0b3c-4ca3-946c-3619c94d5cef tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:50.435506 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0d7ab6e8-0b3c-4ca3-946c-3619c94d5cef tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:50.450162 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0d7ab6e8-0b3c-4ca3-946c-3619c94d5cef tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1708 microversion: 2.1 time: 0.268692 Jun 16 18:10:50.450755 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 261/516] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:50 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1708 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:51.021062 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8c5be924-9580-463b-97ef-c5d435723f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:51.021062 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8c5be924-9580-463b-97ef-c5d435723f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:51.023985 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8c5be924-9580-463b-97ef-c5d435723f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:51.024559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8c5be924-9580-463b-97ef-c5d435723f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:51.025575 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8c5be924-9580-463b-97ef-c5d435723f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:51.026377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8c5be924-9580-463b-97ef-c5d435723f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:51.042109 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6fb9e57a-03aa-4da3-9d97-bdf38087a6e8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:51.042726 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6fb9e57a-03aa-4da3-9d97-bdf38087a6e8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:51.054709 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6fb9e57a-03aa-4da3-9d97-bdf38087a6e8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:51.055171 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6fb9e57a-03aa-4da3-9d97-bdf38087a6e8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:51.056063 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6fb9e57a-03aa-4da3-9d97-bdf38087a6e8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:51.056501 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6fb9e57a-03aa-4da3-9d97-bdf38087a6e8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:51.061274 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=100 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:10:51.250244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8c5be924-9580-463b-97ef-c5d435723f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:51.259356 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8c5be924-9580-463b-97ef-c5d435723f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1443 microversion: 2.1 time: 0.250744 Jun 16 18:10:51.259960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 256/517] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:51 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1443 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:51.266038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6fb9e57a-03aa-4da3-9d97-bdf38087a6e8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:51.276486 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-35d3369b-3cb0-4f3f-bf66-ae3a0bd77ff0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:51.277306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-35d3369b-3cb0-4f3f-bf66-ae3a0bd77ff0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:51.277424 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6fb9e57a-03aa-4da3-9d97-bdf38087a6e8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:51.279249 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6fb9e57a-03aa-4da3-9d97-bdf38087a6e8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:51.280651 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6fb9e57a-03aa-4da3-9d97-bdf38087a6e8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.242489 Jun 16 18:10:51.281380 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 262/518] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:51 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:51.284110 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-35d3369b-3cb0-4f3f-bf66-ae3a0bd77ff0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:51.288932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-35d3369b-3cb0-4f3f-bf66-ae3a0bd77ff0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:51.288932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-35d3369b-3cb0-4f3f-bf66-ae3a0bd77ff0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:51.288932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-35d3369b-3cb0-4f3f-bf66-ae3a0bd77ff0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:51.440794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-35d3369b-3cb0-4f3f-bf66-ae3a0bd77ff0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:51.454310 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-35d3369b-3cb0-4f3f-bf66-ae3a0bd77ff0 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1443 microversion: 2.1 time: 0.181826 Jun 16 18:10:51.455182 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 257/519] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:51 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1443 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:10:51.470334 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4c7ff6c2-9638-4e47-8e22-bb83afe8c949 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:51.471519 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4c7ff6c2-9638-4e47-8e22-bb83afe8c949 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:51.481504 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4c7ff6c2-9638-4e47-8e22-bb83afe8c949 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:51.482256 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4c7ff6c2-9638-4e47-8e22-bb83afe8c949 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:51.483274 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4c7ff6c2-9638-4e47-8e22-bb83afe8c949 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:51.483966 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4c7ff6c2-9638-4e47-8e22-bb83afe8c949 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:51.674725 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4c7ff6c2-9638-4e47-8e22-bb83afe8c949 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:51.688629 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4c7ff6c2-9638-4e47-8e22-bb83afe8c949 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1708 microversion: 2.1 time: 0.223199 Jun 16 18:10:51.693753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 263/520] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:51 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1708 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:52.306146 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-09add057-55a1-4ddd-99ab-f3bdf82cc014 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:52.306972 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-09add057-55a1-4ddd-99ab-f3bdf82cc014 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:52.315462 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-09add057-55a1-4ddd-99ab-f3bdf82cc014 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:52.316027 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-09add057-55a1-4ddd-99ab-f3bdf82cc014 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:52.318110 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-09add057-55a1-4ddd-99ab-f3bdf82cc014 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:52.319691 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-09add057-55a1-4ddd-99ab-f3bdf82cc014 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:52.564825 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-09add057-55a1-4ddd-99ab-f3bdf82cc014 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:52.574490 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-09add057-55a1-4ddd-99ab-f3bdf82cc014 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:52.576344 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-09add057-55a1-4ddd-99ab-f3bdf82cc014 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:52.577798 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-09add057-55a1-4ddd-99ab-f3bdf82cc014 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.275509 Jun 16 18:10:52.589030 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 258/521] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:52 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:52.711030 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3120bd4e-9faa-4fab-8b8b-674a3098ffb1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:52.712640 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3120bd4e-9faa-4fab-8b8b-674a3098ffb1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:52.722317 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3120bd4e-9faa-4fab-8b8b-674a3098ffb1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:52.722907 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3120bd4e-9faa-4fab-8b8b-674a3098ffb1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:52.723919 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3120bd4e-9faa-4fab-8b8b-674a3098ffb1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:52.724662 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3120bd4e-9faa-4fab-8b8b-674a3098ffb1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:52.938351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3120bd4e-9faa-4fab-8b8b-674a3098ffb1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:52.949122 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3120bd4e-9faa-4fab-8b8b-674a3098ffb1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1712 microversion: 2.1 time: 0.242877 Jun 16 18:10:52.950366 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 264/522] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:52 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1712 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:53.598298 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b7200a9c-bfe8-43db-aa28-5b9c06e3aaf7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:53.599006 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b7200a9c-bfe8-43db-aa28-5b9c06e3aaf7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:53.611520 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b7200a9c-bfe8-43db-aa28-5b9c06e3aaf7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:53.612783 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b7200a9c-bfe8-43db-aa28-5b9c06e3aaf7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:53.614712 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b7200a9c-bfe8-43db-aa28-5b9c06e3aaf7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:53.615801 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b7200a9c-bfe8-43db-aa28-5b9c06e3aaf7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:53.976751 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1334553595", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:54.035475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.network.neutron [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] validate_networks() for None {{(pid=118162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:10:54.090484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b7200a9c-bfe8-43db-aa28-5b9c06e3aaf7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:54.099635 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b7200a9c-bfe8-43db-aa28-5b9c06e3aaf7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:54.101717 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b7200a9c-bfe8-43db-aa28-5b9c06e3aaf7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:54.103200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b7200a9c-bfe8-43db-aa28-5b9c06e3aaf7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.510194 Jun 16 18:10:54.116722 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 259/523] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:53 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:54.438158 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Flavor limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:10:54.438834 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Image limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:10:54.439435 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Flavor pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:10:54.440083 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Image pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:10:54.440595 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:10:54.459062 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:54.459959 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:54.461552 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:54.462348 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:54.501769 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Getting quotas for project 42a4b66cbb644093b01587e481741a86. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:10:54.508056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Getting quotas for user 1ff319ceadf84863850254e50774ba5b and project 42a4b66cbb644093b01587e481741a86. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:10:54.529994 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Going to run 1 instances... {{(pid=118162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:10:54.539482 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:10:54.768392 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8b718848-cb91-4c64-b525-bfa2cab38991 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798878 Jun 16 18:10:54.769802 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 265/524] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:10:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:10:54.780338 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-069e33e8-0c20-4077-a3bc-95768e451847 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:54.781849 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-069e33e8-0c20-4077-a3bc-95768e451847 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:54.915777 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-069e33e8-0c20-4077-a3bc-95768e451847 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:54.915777 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-069e33e8-0c20-4077-a3bc-95768e451847 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1215 microversion: 2.1 time: 0.107722 Jun 16 18:10:54.915777 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 260/525] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:54 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:55.122861 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d6a7583b-1a7d-4f35-b384-6e2b0e17a63a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:55.123506 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d6a7583b-1a7d-4f35-b384-6e2b0e17a63a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:55.131309 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d6a7583b-1a7d-4f35-b384-6e2b0e17a63a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:55.131813 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d6a7583b-1a7d-4f35-b384-6e2b0e17a63a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:55.132801 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d6a7583b-1a7d-4f35-b384-6e2b0e17a63a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:55.133242 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d6a7583b-1a7d-4f35-b384-6e2b0e17a63a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:55.280558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d6a7583b-1a7d-4f35-b384-6e2b0e17a63a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:55.289490 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d6a7583b-1a7d-4f35-b384-6e2b0e17a63a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:55.291076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d6a7583b-1a7d-4f35-b384-6e2b0e17a63a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:55.292272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d6a7583b-1a7d-4f35-b384-6e2b0e17a63a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.173493 Jun 16 18:10:55.304662 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 266/526] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:55 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:55.336851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-be9db8c1-ad51-4fb6-b910-2b0dffdd89a9 req-257c346f-db3c-4e39-b6cb-cc0929a37c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6c9426-2d6f-4dfb-8bc8-959827d8cf79", "tag": "aaf3fae1-693c-4fec-8e06-dc30896dc3f7"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:10:55.345783 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-be9db8c1-ad51-4fb6-b910-2b0dffdd89a9 req-257c346f-db3c-4e39-b6cb-cc0929a37c77 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:55.346229 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-be9db8c1-ad51-4fb6-b910-2b0dffdd89a9 req-257c346f-db3c-4e39-b6cb-cc0929a37c77 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:55.357856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-be9db8c1-ad51-4fb6-b910-2b0dffdd89a9 req-257c346f-db3c-4e39-b6cb-cc0929a37c77 service nova] Creating event network-changed:aaf3fae1-693c-4fec-8e06-dc30896dc3f7 for instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79 on hv-cinder-83754 Jun 16 18:10:55.363102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-be9db8c1-ad51-4fb6-b910-2b0dffdd89a9 req-257c346f-db3c-4e39-b6cb-cc0929a37c77 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029952 Jun 16 18:10:55.363752 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 261/527] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:10:55.923514 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-99fa88a9-bf00-4eec-bf4e-5d6fd1845093 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:55.924303 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-99fa88a9-bf00-4eec-bf4e-5d6fd1845093 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:55.997437 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-99fa88a9-bf00-4eec-bf4e-5d6fd1845093 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:56.008264 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-99fa88a9-bf00-4eec-bf4e-5d6fd1845093 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1215 microversion: 2.1 time: 0.088603 Jun 16 18:10:56.009550 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 267/528] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:55 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:56.312711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6aa12bba-a50b-4225-9cfd-ef796b95a083 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:56.314123 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6aa12bba-a50b-4225-9cfd-ef796b95a083 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:56.326238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6aa12bba-a50b-4225-9cfd-ef796b95a083 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:56.326717 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6aa12bba-a50b-4225-9cfd-ef796b95a083 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:56.327890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6aa12bba-a50b-4225-9cfd-ef796b95a083 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:56.328535 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6aa12bba-a50b-4225-9cfd-ef796b95a083 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:56.621188 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6aa12bba-a50b-4225-9cfd-ef796b95a083 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:56.645275 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6aa12bba-a50b-4225-9cfd-ef796b95a083 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:56.654298 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6aa12bba-a50b-4225-9cfd-ef796b95a083 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:56.656977 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6aa12bba-a50b-4225-9cfd-ef796b95a083 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.349417 Jun 16 18:10:56.659694 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 262/529] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:56 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:57.027597 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8580336a-61f0-446e-a70e-60ec0717fa24 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:57.028972 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8580336a-61f0-446e-a70e-60ec0717fa24 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:57.041408 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8580336a-61f0-446e-a70e-60ec0717fa24 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:57.042391 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8580336a-61f0-446e-a70e-60ec0717fa24 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:57.045109 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8580336a-61f0-446e-a70e-60ec0717fa24 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:57.045736 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8580336a-61f0-446e-a70e-60ec0717fa24 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:57.162280 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8580336a-61f0-446e-a70e-60ec0717fa24 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:57.178324 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8580336a-61f0-446e-a70e-60ec0717fa24 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1219 microversion: 2.1 time: 0.155872 Jun 16 18:10:57.180095 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 268/530] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:57 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:57.695275 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-040c7f02-20ce-404e-91f6-5adfa6551cd8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:57.699398 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-040c7f02-20ce-404e-91f6-5adfa6551cd8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:57.710954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-040c7f02-20ce-404e-91f6-5adfa6551cd8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:57.712074 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-040c7f02-20ce-404e-91f6-5adfa6551cd8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:57.714101 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-040c7f02-20ce-404e-91f6-5adfa6551cd8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:57.715273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-040c7f02-20ce-404e-91f6-5adfa6551cd8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:57.997456 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-040c7f02-20ce-404e-91f6-5adfa6551cd8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:58.024649 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-040c7f02-20ce-404e-91f6-5adfa6551cd8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:58.027694 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-040c7f02-20ce-404e-91f6-5adfa6551cd8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:58.030028 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-040c7f02-20ce-404e-91f6-5adfa6551cd8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.351053 Jun 16 18:10:58.051057 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 263/531] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:57 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:58.206735 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4d95785e-c1e0-4dd2-abf4-06e55fd42d22 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:58.207838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4d95785e-c1e0-4dd2-abf4-06e55fd42d22 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:58.216896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4d95785e-c1e0-4dd2-abf4-06e55fd42d22 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:58.218157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4d95785e-c1e0-4dd2-abf4-06e55fd42d22 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:58.219865 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4d95785e-c1e0-4dd2-abf4-06e55fd42d22 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:58.220720 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4d95785e-c1e0-4dd2-abf4-06e55fd42d22 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:58.326424 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4d95785e-c1e0-4dd2-abf4-06e55fd42d22 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:58.338177 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4d95785e-c1e0-4dd2-abf4-06e55fd42d22 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1267 microversion: 2.1 time: 0.142569 Jun 16 18:10:58.340188 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 269/532] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:58 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:10:59.058194 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-75ef8d93-76a3-4edb-a61c-b50c6af74fe4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:59.058836 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-75ef8d93-76a3-4edb-a61c-b50c6af74fe4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:59.066051 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-75ef8d93-76a3-4edb-a61c-b50c6af74fe4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:59.066506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-75ef8d93-76a3-4edb-a61c-b50c6af74fe4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:59.067338 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-75ef8d93-76a3-4edb-a61c-b50c6af74fe4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:59.067794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-75ef8d93-76a3-4edb-a61c-b50c6af74fe4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:59.219314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-75ef8d93-76a3-4edb-a61c-b50c6af74fe4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:59.228322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-75ef8d93-76a3-4edb-a61c-b50c6af74fe4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:59.229868 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-75ef8d93-76a3-4edb-a61c-b50c6af74fe4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:59.231033 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-75ef8d93-76a3-4edb-a61c-b50c6af74fe4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.177255 Jun 16 18:10:59.231617 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 264/533] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:10:59 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:10:59.364906 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-105d4c21-4159-4d63-b0e5-23cfd0ebc807 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:10:59.365782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-105d4c21-4159-4d63-b0e5-23cfd0ebc807 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:10:59.373138 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-105d4c21-4159-4d63-b0e5-23cfd0ebc807 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:59.373618 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-105d4c21-4159-4d63-b0e5-23cfd0ebc807 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:59.374432 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-105d4c21-4159-4d63-b0e5-23cfd0ebc807 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:10:59.374868 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-105d4c21-4159-4d63-b0e5-23cfd0ebc807 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:10:59.445866 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-105d4c21-4159-4d63-b0e5-23cfd0ebc807 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:10:59.454078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-105d4c21-4159-4d63-b0e5-23cfd0ebc807 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1285 microversion: 2.1 time: 0.093097 Jun 16 18:10:59.454544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 270/534] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:10:59 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:00.258015 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-09683dde-82ea-4132-8d51-83de2343f58a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:00.258840 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-09683dde-82ea-4132-8d51-83de2343f58a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:00.266088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-09683dde-82ea-4132-8d51-83de2343f58a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:00.266795 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-09683dde-82ea-4132-8d51-83de2343f58a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:00.267801 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-09683dde-82ea-4132-8d51-83de2343f58a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:00.268238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-09683dde-82ea-4132-8d51-83de2343f58a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:00.472604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-92a6c1e2-3ea9-48fd-b508-1aa74942f2a7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:00.473224 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-92a6c1e2-3ea9-48fd-b508-1aa74942f2a7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:00.485425 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-09683dde-82ea-4132-8d51-83de2343f58a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:00.495073 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-92a6c1e2-3ea9-48fd-b508-1aa74942f2a7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:00.495847 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-92a6c1e2-3ea9-48fd-b508-1aa74942f2a7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:00.496831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-92a6c1e2-3ea9-48fd-b508-1aa74942f2a7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:00.497498 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-92a6c1e2-3ea9-48fd-b508-1aa74942f2a7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:00.499023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-09683dde-82ea-4132-8d51-83de2343f58a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:00.500703 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-09683dde-82ea-4132-8d51-83de2343f58a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:00.501955 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-09683dde-82ea-4132-8d51-83de2343f58a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.249881 Jun 16 18:11:00.503140 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 265/535] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:00 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:00.709518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-92a6c1e2-3ea9-48fd-b508-1aa74942f2a7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:00.720816 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-92a6c1e2-3ea9-48fd-b508-1aa74942f2a7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1315 microversion: 2.1 time: 0.252458 Jun 16 18:11:00.722070 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 271/536] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:00 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:01.525338 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5b764532-4f62-41ad-b850-e6cbfd6d000c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:01.526086 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5b764532-4f62-41ad-b850-e6cbfd6d000c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:01.539294 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5b764532-4f62-41ad-b850-e6cbfd6d000c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:01.540198 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5b764532-4f62-41ad-b850-e6cbfd6d000c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:01.541088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5b764532-4f62-41ad-b850-e6cbfd6d000c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:01.543449 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5b764532-4f62-41ad-b850-e6cbfd6d000c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:01.718404 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5b764532-4f62-41ad-b850-e6cbfd6d000c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:01.731544 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5b764532-4f62-41ad-b850-e6cbfd6d000c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:01.747997 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5b764532-4f62-41ad-b850-e6cbfd6d000c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:01.751259 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0f235629-3ae0-4768-9b03-8c9f708780e0 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:01.752768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0f235629-3ae0-4768-9b03-8c9f708780e0 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:01.753533 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5b764532-4f62-41ad-b850-e6cbfd6d000c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.230524 Jun 16 18:11:01.768867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 266/537] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:01 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:01.781022 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0f235629-3ae0-4768-9b03-8c9f708780e0 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:01.781792 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0f235629-3ae0-4768-9b03-8c9f708780e0 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:01.782804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0f235629-3ae0-4768-9b03-8c9f708780e0 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:01.783434 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0f235629-3ae0-4768-9b03-8c9f708780e0 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:01.846496 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-4d166083-8e9c-4ced-8d7c-1ba2fe6190ac req-f896a96e-ed81-4b77-9f95-77cff800d0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b04cba69-4fbe-486e-9198-66e2e408c8c4", "tag": "72f2ede4-ee23-47f5-88e1-6955e8d36c21"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:11:01.861106 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-4d166083-8e9c-4ced-8d7c-1ba2fe6190ac req-f896a96e-ed81-4b77-9f95-77cff800d0b4 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:01.861924 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-4d166083-8e9c-4ced-8d7c-1ba2fe6190ac req-f896a96e-ed81-4b77-9f95-77cff800d0b4 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:01.876689 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-4d166083-8e9c-4ced-8d7c-1ba2fe6190ac req-f896a96e-ed81-4b77-9f95-77cff800d0b4 service nova] Creating event network-changed:72f2ede4-ee23-47f5-88e1-6955e8d36c21 for instance b04cba69-4fbe-486e-9198-66e2e408c8c4 on hv-cinder-83754 Jun 16 18:11:01.883184 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-4d166083-8e9c-4ced-8d7c-1ba2fe6190ac req-f896a96e-ed81-4b77-9f95-77cff800d0b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040087 Jun 16 18:11:01.888914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 267/538] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:11:02.049214 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0f235629-3ae0-4768-9b03-8c9f708780e0 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:02.062524 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0f235629-3ae0-4768-9b03-8c9f708780e0 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1315 microversion: 2.1 time: 0.324757 Jun 16 18:11:02.063112 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 272/539] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:01 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:11:02.778457 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-4730b7ef-6491-465f-9a22-0df784cc5242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:02.779914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-4730b7ef-6491-465f-9a22-0df784cc5242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:02.788366 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4730b7ef-6491-465f-9a22-0df784cc5242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:02.789649 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4730b7ef-6491-465f-9a22-0df784cc5242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:02.794035 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4730b7ef-6491-465f-9a22-0df784cc5242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:02.794035 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4730b7ef-6491-465f-9a22-0df784cc5242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:02.952675 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4730b7ef-6491-465f-9a22-0df784cc5242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:02.961924 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4730b7ef-6491-465f-9a22-0df784cc5242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:02.964691 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4730b7ef-6491-465f-9a22-0df784cc5242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:02.966087 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-4730b7ef-6491-465f-9a22-0df784cc5242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.193379 Jun 16 18:11:02.966639 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 268/540] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:02 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:03.080498 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-baae647e-50cc-4ffc-a0ee-a5a0875f29f7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:03.081183 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-baae647e-50cc-4ffc-a0ee-a5a0875f29f7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:03.089970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-baae647e-50cc-4ffc-a0ee-a5a0875f29f7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:03.090207 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-baae647e-50cc-4ffc-a0ee-a5a0875f29f7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:03.091032 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-baae647e-50cc-4ffc-a0ee-a5a0875f29f7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:03.091577 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-baae647e-50cc-4ffc-a0ee-a5a0875f29f7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:03.248034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-baae647e-50cc-4ffc-a0ee-a5a0875f29f7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:03.260301 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-baae647e-50cc-4ffc-a0ee-a5a0875f29f7 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1315 microversion: 2.1 time: 0.183987 Jun 16 18:11:03.261391 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 273/541] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:03 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:03.986290 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6f3c3f4d-ad86-4f1b-a4a0-eb89098fb85c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:03.986890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6f3c3f4d-ad86-4f1b-a4a0-eb89098fb85c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:03.993833 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f3c3f4d-ad86-4f1b-a4a0-eb89098fb85c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:03.994270 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f3c3f4d-ad86-4f1b-a4a0-eb89098fb85c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:03.995020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f3c3f4d-ad86-4f1b-a4a0-eb89098fb85c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:03.995478 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f3c3f4d-ad86-4f1b-a4a0-eb89098fb85c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:04.185434 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6f3c3f4d-ad86-4f1b-a4a0-eb89098fb85c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:04.201905 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6f3c3f4d-ad86-4f1b-a4a0-eb89098fb85c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:04.205398 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6f3c3f4d-ad86-4f1b-a4a0-eb89098fb85c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:04.207933 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6f3c3f4d-ad86-4f1b-a4a0-eb89098fb85c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.224936 Jun 16 18:11:04.209015 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 269/542] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:03 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:04.282442 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-936e52ce-5fa9-4ede-a586-4729f6b07bd1 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:04.283346 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-936e52ce-5fa9-4ede-a586-4729f6b07bd1 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:04.290455 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-936e52ce-5fa9-4ede-a586-4729f6b07bd1 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:04.290928 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-936e52ce-5fa9-4ede-a586-4729f6b07bd1 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:04.291898 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-936e52ce-5fa9-4ede-a586-4729f6b07bd1 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:04.292358 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-936e52ce-5fa9-4ede-a586-4729f6b07bd1 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:04.465346 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-936e52ce-5fa9-4ede-a586-4729f6b07bd1 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:04.473117 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-936e52ce-5fa9-4ede-a586-4729f6b07bd1 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1315 microversion: 2.1 time: 0.197403 Jun 16 18:11:04.473708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 274/543] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:04 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:05.229092 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-32fa3bdd-016a-447d-9653-5d159d4c2710 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:05.235147 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-32fa3bdd-016a-447d-9653-5d159d4c2710 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:05.235147 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:05.240155 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-32fa3bdd-016a-447d-9653-5d159d4c2710 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:05.240773 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-32fa3bdd-016a-447d-9653-5d159d4c2710 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:05.241730 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-32fa3bdd-016a-447d-9653-5d159d4c2710 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:05.242480 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-32fa3bdd-016a-447d-9653-5d159d4c2710 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:05.264060 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:05.384238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-32fa3bdd-016a-447d-9653-5d159d4c2710 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:05.392137 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-32fa3bdd-016a-447d-9653-5d159d4c2710 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:05.393662 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-32fa3bdd-016a-447d-9653-5d159d4c2710 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:05.394816 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-32fa3bdd-016a-447d-9653-5d159d4c2710 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.170817 Jun 16 18:11:05.395387 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 270/544] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:05 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:05.498152 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5de25156-ffa9-4c1d-b695-c0359e2aef50 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:05.498729 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5de25156-ffa9-4c1d-b695-c0359e2aef50 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:05.500536 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:05.501681 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:05.507002 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5de25156-ffa9-4c1d-b695-c0359e2aef50 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:05.507486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5de25156-ffa9-4c1d-b695-c0359e2aef50 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:05.508829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5de25156-ffa9-4c1d-b695-c0359e2aef50 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:05.509269 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5de25156-ffa9-4c1d-b695-c0359e2aef50 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:05.646910 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5de25156-ffa9-4c1d-b695-c0359e2aef50 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:05.655515 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5de25156-ffa9-4c1d-b695-c0359e2aef50 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1315 microversion: 2.1 time: 0.161185 Jun 16 18:11:05.656125 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 275/545] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:05 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:06.413736 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-06d602c4-1ee9-4834-a53d-102302abdbc1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:06.415194 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-06d602c4-1ee9-4834-a53d-102302abdbc1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:06.422866 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-06d602c4-1ee9-4834-a53d-102302abdbc1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:06.423314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-06d602c4-1ee9-4834-a53d-102302abdbc1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:06.424402 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-06d602c4-1ee9-4834-a53d-102302abdbc1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:06.424580 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-06d602c4-1ee9-4834-a53d-102302abdbc1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:06.568560 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-06d602c4-1ee9-4834-a53d-102302abdbc1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:06.577205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-06d602c4-1ee9-4834-a53d-102302abdbc1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:06.578693 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-06d602c4-1ee9-4834-a53d-102302abdbc1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:06.580056 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-06d602c4-1ee9-4834-a53d-102302abdbc1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1739 microversion: 2.20 time: 0.170161 Jun 16 18:11:06.580610 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 271/546] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:06 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:06.674421 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-46974c02-d31c-4da2-b45f-3fd8ff649246 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:06.675256 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-46974c02-d31c-4da2-b45f-3fd8ff649246 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:06.677226 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=8 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:06.682928 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-46974c02-d31c-4da2-b45f-3fd8ff649246 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:06.683384 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-46974c02-d31c-4da2-b45f-3fd8ff649246 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:06.684198 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-46974c02-d31c-4da2-b45f-3fd8ff649246 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:06.684632 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-46974c02-d31c-4da2-b45f-3fd8ff649246 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:06.824514 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-46974c02-d31c-4da2-b45f-3fd8ff649246 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:06.832433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-46974c02-d31c-4da2-b45f-3fd8ff649246 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1315 microversion: 2.1 time: 0.162548 Jun 16 18:11:06.833019 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 276/547] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:06 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:11:07.598695 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-679cc025-545d-4a5e-b16b-c148b04ce937 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:07.599694 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-679cc025-545d-4a5e-b16b-c148b04ce937 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:07.608669 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-679cc025-545d-4a5e-b16b-c148b04ce937 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:07.615169 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-679cc025-545d-4a5e-b16b-c148b04ce937 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:07.615169 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-679cc025-545d-4a5e-b16b-c148b04ce937 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:07.615169 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-679cc025-545d-4a5e-b16b-c148b04ce937 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:07.795340 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-679cc025-545d-4a5e-b16b-c148b04ce937 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:07.805827 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-679cc025-545d-4a5e-b16b-c148b04ce937 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:07.807578 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-679cc025-545d-4a5e-b16b-c148b04ce937 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:07.809224 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-679cc025-545d-4a5e-b16b-c148b04ce937 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1721 microversion: 2.20 time: 0.214595 Jun 16 18:11:07.809987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 272/548] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:07 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:07.849640 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ebab4809-a04a-43b7-9e75-cfa9e766c2d5 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:07.850309 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ebab4809-a04a-43b7-9e75-cfa9e766c2d5 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:07.858365 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ebab4809-a04a-43b7-9e75-cfa9e766c2d5 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:07.858813 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ebab4809-a04a-43b7-9e75-cfa9e766c2d5 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:07.859619 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ebab4809-a04a-43b7-9e75-cfa9e766c2d5 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:07.860055 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ebab4809-a04a-43b7-9e75-cfa9e766c2d5 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:08.008865 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ebab4809-a04a-43b7-9e75-cfa9e766c2d5 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:08.016649 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ebab4809-a04a-43b7-9e75-cfa9e766c2d5 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1315 microversion: 2.1 time: 0.170861 Jun 16 18:11:08.017227 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 277/549] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:07 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:08.829744 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d6aca14a-d056-49a7-b5c9-6c06302992e2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:08.830375 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d6aca14a-d056-49a7-b5c9-6c06302992e2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:08.837634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d6aca14a-d056-49a7-b5c9-6c06302992e2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:08.838134 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d6aca14a-d056-49a7-b5c9-6c06302992e2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:08.838996 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d6aca14a-d056-49a7-b5c9-6c06302992e2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:08.839465 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d6aca14a-d056-49a7-b5c9-6c06302992e2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:08.997849 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d6aca14a-d056-49a7-b5c9-6c06302992e2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:09.006358 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d6aca14a-d056-49a7-b5c9-6c06302992e2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:09.007895 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d6aca14a-d056-49a7-b5c9-6c06302992e2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:09.009805 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d6aca14a-d056-49a7-b5c9-6c06302992e2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1721 microversion: 2.20 time: 0.184035 Jun 16 18:11:09.010376 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 273/550] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:08 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:09.034940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2beee98a-4477-42ed-a73f-61894c77c37e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:09.035697 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2beee98a-4477-42ed-a73f-61894c77c37e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:09.042068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2beee98a-4477-42ed-a73f-61894c77c37e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:09.042523 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2beee98a-4477-42ed-a73f-61894c77c37e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:09.043309 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2beee98a-4477-42ed-a73f-61894c77c37e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:09.043766 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2beee98a-4477-42ed-a73f-61894c77c37e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:09.189312 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2beee98a-4477-42ed-a73f-61894c77c37e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:09.199427 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2beee98a-4477-42ed-a73f-61894c77c37e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1315 microversion: 2.1 time: 0.168852 Jun 16 18:11:09.200021 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 278/551] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:09 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:09.939293 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-a5e95d5e-a674-4033-9eac-eca40d0ab621 req-63ee9b31-cd37-426d-a95b-83bba7ea63a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04cba69-4fbe-486e-9198-66e2e408c8c4", "name": "network-vif-plugged", "status": "completed", "tag": "72f2ede4-ee23-47f5-88e1-6955e8d36c21"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:11:09.948781 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-a5e95d5e-a674-4033-9eac-eca40d0ab621 req-63ee9b31-cd37-426d-a95b-83bba7ea63a7 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:09.949219 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-a5e95d5e-a674-4033-9eac-eca40d0ab621 req-63ee9b31-cd37-426d-a95b-83bba7ea63a7 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:09.959821 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-a5e95d5e-a674-4033-9eac-eca40d0ab621 req-63ee9b31-cd37-426d-a95b-83bba7ea63a7 service nova] Creating event network-vif-plugged:72f2ede4-ee23-47f5-88e1-6955e8d36c21 for instance b04cba69-4fbe-486e-9198-66e2e408c8c4 on hv-cinder-83754 Jun 16 18:11:09.965402 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-a5e95d5e-a674-4033-9eac-eca40d0ab621 req-63ee9b31-cd37-426d-a95b-83bba7ea63a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031054 Jun 16 18:11:09.965983 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 274/552] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:11:10.035769 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-450b7d04-a618-44a3-8f3b-9cc11e68a08b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:10.036371 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-450b7d04-a618-44a3-8f3b-9cc11e68a08b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:10.048587 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-450b7d04-a618-44a3-8f3b-9cc11e68a08b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:10.049392 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-450b7d04-a618-44a3-8f3b-9cc11e68a08b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:10.050677 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-450b7d04-a618-44a3-8f3b-9cc11e68a08b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:10.051393 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-450b7d04-a618-44a3-8f3b-9cc11e68a08b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:10.195058 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-450b7d04-a618-44a3-8f3b-9cc11e68a08b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:10.205872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-450b7d04-a618-44a3-8f3b-9cc11e68a08b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:10.207631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-450b7d04-a618-44a3-8f3b-9cc11e68a08b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:10.208770 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-450b7d04-a618-44a3-8f3b-9cc11e68a08b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1721 microversion: 2.20 time: 0.177150 Jun 16 18:11:10.209326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 279/553] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:10 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:10.227821 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-189dd398-2ff3-4e28-8684-2381c5eb1d1a tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:10.228531 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-189dd398-2ff3-4e28-8684-2381c5eb1d1a tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:10.235070 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-189dd398-2ff3-4e28-8684-2381c5eb1d1a tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:10.235738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-189dd398-2ff3-4e28-8684-2381c5eb1d1a tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:10.236446 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-189dd398-2ff3-4e28-8684-2381c5eb1d1a tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:10.236877 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-189dd398-2ff3-4e28-8684-2381c5eb1d1a tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:10.388594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-189dd398-2ff3-4e28-8684-2381c5eb1d1a tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:10.396374 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-189dd398-2ff3-4e28-8684-2381c5eb1d1a tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1315 microversion: 2.1 time: 0.173550 Jun 16 18:11:10.396921 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 275/554] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:10 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:11.236910 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-648971c2-7b0f-4a24-a77f-eb9f89f1356d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:11.237543 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-648971c2-7b0f-4a24-a77f-eb9f89f1356d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:11.244978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-648971c2-7b0f-4a24-a77f-eb9f89f1356d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:11.245426 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-648971c2-7b0f-4a24-a77f-eb9f89f1356d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:11.246204 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-648971c2-7b0f-4a24-a77f-eb9f89f1356d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:11.246636 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-648971c2-7b0f-4a24-a77f-eb9f89f1356d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:11.267555 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=100 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:11.390671 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-648971c2-7b0f-4a24-a77f-eb9f89f1356d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:11.399008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-648971c2-7b0f-4a24-a77f-eb9f89f1356d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:11.401608 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-648971c2-7b0f-4a24-a77f-eb9f89f1356d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:11.402818 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-648971c2-7b0f-4a24-a77f-eb9f89f1356d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1724 microversion: 2.20 time: 0.169941 Jun 16 18:11:11.403409 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 280/555] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:11 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:11:11.416733 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5d96d68d-c6e8-4cfa-b854-7b4bb2b68898 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:11.417355 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5d96d68d-c6e8-4cfa-b854-7b4bb2b68898 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:11.419768 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=76 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:11.425238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d96d68d-c6e8-4cfa-b854-7b4bb2b68898 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:11.426670 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d96d68d-c6e8-4cfa-b854-7b4bb2b68898 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:11.426670 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d96d68d-c6e8-4cfa-b854-7b4bb2b68898 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:11.426903 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d96d68d-c6e8-4cfa-b854-7b4bb2b68898 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:11.428334 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3a92dda1-d114-49a1-9fdf-38a544129bd9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e76996f-e9d2-4d13-97dd-c9e2fada9d14"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:11:11.429596 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3a92dda1-d114-49a1-9fdf-38a544129bd9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:11.436354 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3a92dda1-d114-49a1-9fdf-38a544129bd9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:11.436795 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3a92dda1-d114-49a1-9fdf-38a544129bd9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:11.437600 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3a92dda1-d114-49a1-9fdf-38a544129bd9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:11.438031 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3a92dda1-d114-49a1-9fdf-38a544129bd9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:11.591713 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5d96d68d-c6e8-4cfa-b854-7b4bb2b68898 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:11.599255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5d96d68d-c6e8-4cfa-b854-7b4bb2b68898 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1315 microversion: 2.1 time: 0.187167 Jun 16 18:11:11.599842 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 276/556] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:11 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:11:11.979912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-0f5da396-0131-413e-bbc8-89f3c8ed069c req-8c371c6b-decb-4685-b3cb-c980b00ad14c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279175ca-aad1-40da-a191-4712cbd17771", "name": "network-vif-unplugged", "status": "completed", "tag": "d3e274fe-5d79-4687-9f75-5a8fd858ef61"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:11:11.988012 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-0f5da396-0131-413e-bbc8-89f3c8ed069c req-8c371c6b-decb-4685-b3cb-c980b00ad14c service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:11.988450 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-0f5da396-0131-413e-bbc8-89f3c8ed069c req-8c371c6b-decb-4685-b3cb-c980b00ad14c service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:11.999993 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-0f5da396-0131-413e-bbc8-89f3c8ed069c req-8c371c6b-decb-4685-b3cb-c980b00ad14c service nova] Creating event network-vif-unplugged:d3e274fe-5d79-4687-9f75-5a8fd858ef61 for instance 279175ca-aad1-40da-a191-4712cbd17771 on hv-cinder-83754 Jun 16 18:11:12.004997 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-0f5da396-0131-413e-bbc8-89f3c8ed069c req-8c371c6b-decb-4685-b3cb-c980b00ad14c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028816 Jun 16 18:11:12.005576 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 277/557] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:11:12.618490 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f8cb74bd-5c20-4774-9eb8-7deb1c7f84f2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:12.619228 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f8cb74bd-5c20-4774-9eb8-7deb1c7f84f2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:12.626754 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f8cb74bd-5c20-4774-9eb8-7deb1c7f84f2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:12.627206 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f8cb74bd-5c20-4774-9eb8-7deb1c7f84f2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:12.628012 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f8cb74bd-5c20-4774-9eb8-7deb1c7f84f2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:12.628447 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f8cb74bd-5c20-4774-9eb8-7deb1c7f84f2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:12.804522 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f8cb74bd-5c20-4774-9eb8-7deb1c7f84f2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:12.812862 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f8cb74bd-5c20-4774-9eb8-7deb1c7f84f2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1315 microversion: 2.1 time: 0.198704 Jun 16 18:11:12.813433 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 278/558] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:12 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:11:13.204846 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3a92dda1-d114-49a1-9fdf-38a544129bd9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "POST /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.780863 Jun 16 18:11:13.205528 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 281/559] 10.222.0.58 () {62 vars in 1363 bytes} [Thu Jun 16 18:11:11 2022] POST /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments => generated 188 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:11:13.366873 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-58dc769b-c528-407e-a44b-d6345b14868b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:11:13.367488 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-58dc769b-c528-407e-a44b-d6345b14868b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:13.374348 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-58dc769b-c528-407e-a44b-d6345b14868b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:13.374830 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-58dc769b-c528-407e-a44b-d6345b14868b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:13.375638 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-58dc769b-c528-407e-a44b-d6345b14868b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:13.376074 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-58dc769b-c528-407e-a44b-d6345b14868b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:13.740196 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-58dc769b-c528-407e-a44b-d6345b14868b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "POST /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/action" status: 202 len: 0 microversion: 2.20 time: 0.377208 Jun 16 18:11:13.743556 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 279/560] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Jun 16 18:11:13 2022] POST /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:11:13.749549 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-627e854d-acca-4107-8137-78eeb128701b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:13.750154 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-627e854d-acca-4107-8137-78eeb128701b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:13.757136 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-627e854d-acca-4107-8137-78eeb128701b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:13.757572 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-627e854d-acca-4107-8137-78eeb128701b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:13.758907 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-627e854d-acca-4107-8137-78eeb128701b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:13.758907 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-627e854d-acca-4107-8137-78eeb128701b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:13.831871 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8ac79136-56f2-4afd-baed-119a5304ae93 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:13.832733 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8ac79136-56f2-4afd-baed-119a5304ae93 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:13.839740 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8ac79136-56f2-4afd-baed-119a5304ae93 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:13.840029 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8ac79136-56f2-4afd-baed-119a5304ae93 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:13.840804 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8ac79136-56f2-4afd-baed-119a5304ae93 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:13.841239 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8ac79136-56f2-4afd-baed-119a5304ae93 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:13.938260 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-627e854d-acca-4107-8137-78eeb128701b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:13.948790 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-627e854d-acca-4107-8137-78eeb128701b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:13.950625 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-627e854d-acca-4107-8137-78eeb128701b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:13.952078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-627e854d-acca-4107-8137-78eeb128701b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1750 microversion: 2.20 time: 0.206993 Jun 16 18:11:13.952873 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 282/561] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:13 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1750 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:14.004164 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8ac79136-56f2-4afd-baed-119a5304ae93 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:14.013187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8ac79136-56f2-4afd-baed-119a5304ae93 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1465 microversion: 2.1 time: 0.185881 Jun 16 18:11:14.013757 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 280/562] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:13 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1465 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:14.062497 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8af35775-9a3c-4b22-923a-a76b57b3db5e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:14.063092 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8af35775-9a3c-4b22-923a-a76b57b3db5e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:14.069054 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8af35775-9a3c-4b22-923a-a76b57b3db5e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:14.069492 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8af35775-9a3c-4b22-923a-a76b57b3db5e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:14.070254 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8af35775-9a3c-4b22-923a-a76b57b3db5e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:14.070681 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8af35775-9a3c-4b22-923a-a76b57b3db5e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:14.100558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8af35775-9a3c-4b22-923a-a76b57b3db5e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Going to try to terminate instance {{(pid=118162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:11:14.651226 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8af35775-9a3c-4b22-923a-a76b57b3db5e tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 204 len: 0 microversion: 2.1 time: 0.593296 Jun 16 18:11:14.651226 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 283/563] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:11:14 2022] DELETE /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:11:14.655455 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-44447f85-194d-402e-9ddf-fb20dbd4be68 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:14.656769 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-44447f85-194d-402e-9ddf-fb20dbd4be68 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:14.665319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-44447f85-194d-402e-9ddf-fb20dbd4be68 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:14.665699 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-44447f85-194d-402e-9ddf-fb20dbd4be68 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:14.666468 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-44447f85-194d-402e-9ddf-fb20dbd4be68 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:14.666895 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-44447f85-194d-402e-9ddf-fb20dbd4be68 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:14.819268 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-44447f85-194d-402e-9ddf-fb20dbd4be68 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:14.829362 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-44447f85-194d-402e-9ddf-fb20dbd4be68 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1471 microversion: 2.1 time: 0.178183 Jun 16 18:11:14.829966 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 281/564] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:14 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:14.971433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-57752e31-c1bc-4cd8-ab0e-0c00c2599201 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:14.972143 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-57752e31-c1bc-4cd8-ab0e-0c00c2599201 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:14.982551 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-57752e31-c1bc-4cd8-ab0e-0c00c2599201 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:14.983253 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-57752e31-c1bc-4cd8-ab0e-0c00c2599201 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:14.984539 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-57752e31-c1bc-4cd8-ab0e-0c00c2599201 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:14.985214 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-57752e31-c1bc-4cd8-ab0e-0c00c2599201 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:15.141698 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-57752e31-c1bc-4cd8-ab0e-0c00c2599201 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:15.150553 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-57752e31-c1bc-4cd8-ab0e-0c00c2599201 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:15.152592 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-57752e31-c1bc-4cd8-ab0e-0c00c2599201 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:15.153753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-57752e31-c1bc-4cd8-ab0e-0c00c2599201 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1750 microversion: 2.20 time: 0.186637 Jun 16 18:11:15.154310 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 284/565] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:14 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1750 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:15.847182 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c09eb23c-ffae-41f8-9fdd-a2ae2196567d tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:15.847881 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c09eb23c-ffae-41f8-9fdd-a2ae2196567d tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:15.854574 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c09eb23c-ffae-41f8-9fdd-a2ae2196567d tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:15.855651 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c09eb23c-ffae-41f8-9fdd-a2ae2196567d tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:15.856417 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c09eb23c-ffae-41f8-9fdd-a2ae2196567d tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:15.856851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c09eb23c-ffae-41f8-9fdd-a2ae2196567d tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:15.998109 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c09eb23c-ffae-41f8-9fdd-a2ae2196567d tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:16.006515 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c09eb23c-ffae-41f8-9fdd-a2ae2196567d tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1471 microversion: 2.1 time: 0.163316 Jun 16 18:11:16.007104 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 282/566] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:15 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:16.173618 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e694fe3a-8d7f-451b-9e05-da1724d14832 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:16.174346 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e694fe3a-8d7f-451b-9e05-da1724d14832 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:16.189769 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e694fe3a-8d7f-451b-9e05-da1724d14832 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:16.189769 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e694fe3a-8d7f-451b-9e05-da1724d14832 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:16.189769 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e694fe3a-8d7f-451b-9e05-da1724d14832 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:16.189769 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e694fe3a-8d7f-451b-9e05-da1724d14832 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:16.338105 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e694fe3a-8d7f-451b-9e05-da1724d14832 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:16.347680 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e694fe3a-8d7f-451b-9e05-da1724d14832 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:16.349179 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e694fe3a-8d7f-451b-9e05-da1724d14832 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:16.350338 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e694fe3a-8d7f-451b-9e05-da1724d14832 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1750 microversion: 2.20 time: 0.180919 Jun 16 18:11:16.350901 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 285/567] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:16 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:17.026076 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e6b5df47-65fb-476c-a586-690c0e4076d2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:17.036696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e6b5df47-65fb-476c-a586-690c0e4076d2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:17.036696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e6b5df47-65fb-476c-a586-690c0e4076d2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:17.036696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e6b5df47-65fb-476c-a586-690c0e4076d2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:17.036696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e6b5df47-65fb-476c-a586-690c0e4076d2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:17.037083 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e6b5df47-65fb-476c-a586-690c0e4076d2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:17.182302 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e6b5df47-65fb-476c-a586-690c0e4076d2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:17.190701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e6b5df47-65fb-476c-a586-690c0e4076d2 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1471 microversion: 2.1 time: 0.169801 Jun 16 18:11:17.191272 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 283/568] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:17 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:17.297636 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-99f26a34-53df-478c-b2c5-c3d50cf14a19 req-18983d47-6443-48c7-81f9-6d7661358235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04cba69-4fbe-486e-9198-66e2e408c8c4", "name": "network-vif-deleted", "tag": "72f2ede4-ee23-47f5-88e1-6955e8d36c21"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:11:17.310420 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-99f26a34-53df-478c-b2c5-c3d50cf14a19 req-18983d47-6443-48c7-81f9-6d7661358235 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:17.311165 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-99f26a34-53df-478c-b2c5-c3d50cf14a19 req-18983d47-6443-48c7-81f9-6d7661358235 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:17.323183 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-99f26a34-53df-478c-b2c5-c3d50cf14a19 req-18983d47-6443-48c7-81f9-6d7661358235 service nova] Creating event network-vif-deleted:72f2ede4-ee23-47f5-88e1-6955e8d36c21 for instance b04cba69-4fbe-486e-9198-66e2e408c8c4 on hv-cinder-83754 Jun 16 18:11:17.329586 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-99f26a34-53df-478c-b2c5-c3d50cf14a19 req-18983d47-6443-48c7-81f9-6d7661358235 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039719 Jun 16 18:11:17.330190 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 286/569] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:11:17.374843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-671351a6-aeab-4d7e-ba7a-2854d5d3fe97 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:17.376509 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-671351a6-aeab-4d7e-ba7a-2854d5d3fe97 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:17.389383 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-671351a6-aeab-4d7e-ba7a-2854d5d3fe97 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:17.390274 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-671351a6-aeab-4d7e-ba7a-2854d5d3fe97 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:17.391681 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-671351a6-aeab-4d7e-ba7a-2854d5d3fe97 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:17.392496 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-671351a6-aeab-4d7e-ba7a-2854d5d3fe97 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:17.545040 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-671351a6-aeab-4d7e-ba7a-2854d5d3fe97 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:17.555295 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-671351a6-aeab-4d7e-ba7a-2854d5d3fe97 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:17.556911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-671351a6-aeab-4d7e-ba7a-2854d5d3fe97 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:17.558611 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-671351a6-aeab-4d7e-ba7a-2854d5d3fe97 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1752 microversion: 2.20 time: 0.190764 Jun 16 18:11:17.558875 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 284/570] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:17 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1752 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:11:18.209642 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-33a8f267-ed1d-4bbc-adba-8fc47b176dc9 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:18.210558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-33a8f267-ed1d-4bbc-adba-8fc47b176dc9 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:18.217810 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33a8f267-ed1d-4bbc-adba-8fc47b176dc9 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:18.218250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33a8f267-ed1d-4bbc-adba-8fc47b176dc9 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:18.219096 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33a8f267-ed1d-4bbc-adba-8fc47b176dc9 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:18.219564 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33a8f267-ed1d-4bbc-adba-8fc47b176dc9 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:18.256543 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33a8f267-ed1d-4bbc-adba-8fc47b176dc9 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:18.257023 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33a8f267-ed1d-4bbc-adba-8fc47b176dc9 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:18.257482 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-33a8f267-ed1d-4bbc-adba-8fc47b176dc9 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lazy-loading 'fault' on Instance uuid b04cba69-4fbe-486e-9198-66e2e408c8c4 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:11:18.305410 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-33a8f267-ed1d-4bbc-adba-8fc47b176dc9 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff319ceadf84863850254e50774ba5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a4b66cbb644093b01587e481741a86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:18.313888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-33a8f267-ed1d-4bbc-adba-8fc47b176dc9 tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 200 len: 1305 microversion: 2.1 time: 0.109190 Jun 16 18:11:18.314452 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 287/571] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:18 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:18.580089 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-12128fa8-90f5-4d6b-be99-4d070e1408e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:18.580967 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-12128fa8-90f5-4d6b-be99-4d070e1408e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:18.588025 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-12128fa8-90f5-4d6b-be99-4d070e1408e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:18.588474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-12128fa8-90f5-4d6b-be99-4d070e1408e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:18.589825 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-12128fa8-90f5-4d6b-be99-4d070e1408e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:18.590313 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-12128fa8-90f5-4d6b-be99-4d070e1408e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:18.728609 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-12128fa8-90f5-4d6b-be99-4d070e1408e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:18.739742 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-12128fa8-90f5-4d6b-be99-4d070e1408e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:18.741400 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-12128fa8-90f5-4d6b-be99-4d070e1408e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:18.742552 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-12128fa8-90f5-4d6b-be99-4d070e1408e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1752 microversion: 2.20 time: 0.168703 Jun 16 18:11:18.743148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 285/572] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:18 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:19.331743 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f6e2de6c-7f37-4c48-a885-c5599026d2ba tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:19.332294 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f6e2de6c-7f37-4c48-a885-c5599026d2ba tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] [instance: b04cba69-4fbe-486e-9198-66e2e408c8c4] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:19.339019 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f6e2de6c-7f37-4c48-a885-c5599026d2ba tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:19.340148 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f6e2de6c-7f37-4c48-a885-c5599026d2ba tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:19.341576 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f6e2de6c-7f37-4c48-a885-c5599026d2ba tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:19.341984 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f6e2de6c-7f37-4c48-a885-c5599026d2ba tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:19.357928 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-f6e2de6c-7f37-4c48-a885-c5599026d2ba tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] HTTP exception thrown: Instance b04cba69-4fbe-486e-9198-66e2e408c8c4 could not be found. Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f6e2de6c-7f37-4c48-a885-c5599026d2ba tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Request method failure captured: Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 HTTP/1.1 Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3IqomJfAnXNnCdxOrwgWWrZSOBXsQSAfoTkV8bipHhJ7BnD9KSXZ-_iGYrsff0VBSq0k1lt9RoRCRDEL6zsgC2rQze8TTqSlkVIdBXMp2NavKNgqqUNdcC2FnaJNAb542iQD4ayBeqwQwHSC5KP4kA9VPjK0W4YJiupWBUzuwv9dO8 Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 42a4b66cbb644093b01587e481741a86 Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-VolumesNegativeTest-1756783810 Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:11:19.364422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:11:19.365970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_42a4b66cbb644093b01587e481741a86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42a4b66cbb644093b01587e481741a86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/42a4b66cbb644093b01587e481741a86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/42a4b66cbb644093b01587e481741a86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:11:19.365970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-VolumesNegativeTest-1756783810 Jun 16 18:11:19.365970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 42a4b66cbb644093b01587e481741a86 Jun 16 18:11:19.365970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-VolumesNegativeTest-1756783810 Jun 16 18:11:19.365970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-VolumesNegativeTest-1756783810-project Jun 16 18:11:19.365970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:11:19.365970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:11:19.365970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 1ff319ceadf84863850254e50774ba5b Jun 16 18:11:19.365970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-VolumesNegativeTest-1756783810-project Jun 16 18:11:19.365970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:11:19.365970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance b04cba69-4fbe-486e-9198-66e2e408c8c4 could not be found. Jun 16 18:11:19.365970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': 'b04cba69-4fbe-486e-9198-66e2e408c8c4'} Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b04cba69-4fbe-486e-9198-66e2e408c8c4 could not be found. Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:11:19.366767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b04cba69-4fbe-486e-9198-66e2e408c8c4 could not be found. Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b04cba69-4fbe-486e-9198-66e2e408c8c4 could not be found. Jun 16 18:11:19.368556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:11:19.369789 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f6e2de6c-7f37-4c48-a885-c5599026d2ba tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] Returning 404 to user: Instance b04cba69-4fbe-486e-9198-66e2e408c8c4 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:11:19.369789 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f6e2de6c-7f37-4c48-a885-c5599026d2ba tempest-VolumesNegativeTest-1756783810 tempest-VolumesNegativeTest-1756783810-project] 10.222.0.58 "GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4" status: 404 len: 111 microversion: 2.1 time: 0.033389 Jun 16 18:11:19.369789 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 288/573] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:19 2022] GET /compute/v2.1/servers/b04cba69-4fbe-486e-9198-66e2e408c8c4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:11:19.538142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2ffbdc7a-80fe-4311-935c-846d202eb565 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "940d64c2-2d78-4026-99c2-03ce75dfa643"}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:11:19.539226 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2ffbdc7a-80fe-4311-935c-846d202eb565 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:19.550142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2ffbdc7a-80fe-4311-935c-846d202eb565 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:19.550142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2ffbdc7a-80fe-4311-935c-846d202eb565 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:19.550142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2ffbdc7a-80fe-4311-935c-846d202eb565 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:19.550142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2ffbdc7a-80fe-4311-935c-846d202eb565 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:19.762871 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b954d16b-8bd3-4c8c-be27-e0baac89b260 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:19.763536 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b954d16b-8bd3-4c8c-be27-e0baac89b260 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:19.771565 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b954d16b-8bd3-4c8c-be27-e0baac89b260 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:19.772289 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b954d16b-8bd3-4c8c-be27-e0baac89b260 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:19.773331 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b954d16b-8bd3-4c8c-be27-e0baac89b260 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:19.774033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b954d16b-8bd3-4c8c-be27-e0baac89b260 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:19.945879 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b954d16b-8bd3-4c8c-be27-e0baac89b260 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:19.956797 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b954d16b-8bd3-4c8c-be27-e0baac89b260 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:19.958572 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b954d16b-8bd3-4c8c-be27-e0baac89b260 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:19.959835 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b954d16b-8bd3-4c8c-be27-e0baac89b260 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.201639 Jun 16 18:11:19.960384 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 289/574] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:19 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:11:20.633005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:20.833140 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2ffbdc7a-80fe-4311-935c-846d202eb565 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "POST /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.299676 Jun 16 18:11:20.833753 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 286/575] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:11:19 2022] POST /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments => generated 194 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:11:20.979541 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-78d6b75d-a08f-4053-9b69-696c54d32915 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:20.981086 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-78d6b75d-a08f-4053-9b69-696c54d32915 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:20.991495 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-78d6b75d-a08f-4053-9b69-696c54d32915 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:20.992156 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-78d6b75d-a08f-4053-9b69-696c54d32915 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:20.994105 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-78d6b75d-a08f-4053-9b69-696c54d32915 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:20.994733 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-78d6b75d-a08f-4053-9b69-696c54d32915 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:21.220593 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-78d6b75d-a08f-4053-9b69-696c54d32915 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:21.232634 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-78d6b75d-a08f-4053-9b69-696c54d32915 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:21.235102 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-78d6b75d-a08f-4053-9b69-696c54d32915 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:21.237968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-78d6b75d-a08f-4053-9b69-696c54d32915 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.263057 Jun 16 18:11:21.240957 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 290/576] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:20 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:22.271389 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5391b4d9-22bc-46dc-bfde-e3ec86ed525c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:22.272985 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5391b4d9-22bc-46dc-bfde-e3ec86ed525c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:22.285743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5391b4d9-22bc-46dc-bfde-e3ec86ed525c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:22.286686 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5391b4d9-22bc-46dc-bfde-e3ec86ed525c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:22.288156 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5391b4d9-22bc-46dc-bfde-e3ec86ed525c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:22.289049 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5391b4d9-22bc-46dc-bfde-e3ec86ed525c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:22.608895 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5391b4d9-22bc-46dc-bfde-e3ec86ed525c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:22.626253 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5391b4d9-22bc-46dc-bfde-e3ec86ed525c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:22.629925 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5391b4d9-22bc-46dc-bfde-e3ec86ed525c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:22.631442 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5391b4d9-22bc-46dc-bfde-e3ec86ed525c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.366745 Jun 16 18:11:22.632370 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 287/577] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:22 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:23.651955 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2ca38569-34de-4fbc-9672-fc87586647bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:23.652795 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2ca38569-34de-4fbc-9672-fc87586647bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:23.660508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2ca38569-34de-4fbc-9672-fc87586647bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:23.661014 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2ca38569-34de-4fbc-9672-fc87586647bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:23.661809 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2ca38569-34de-4fbc-9672-fc87586647bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:23.662250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2ca38569-34de-4fbc-9672-fc87586647bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:24.406254 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2ca38569-34de-4fbc-9672-fc87586647bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:24.432416 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2ca38569-34de-4fbc-9672-fc87586647bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:24.435052 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2ca38569-34de-4fbc-9672-fc87586647bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:24.437321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2ca38569-34de-4fbc-9672-fc87586647bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.789044 Jun 16 18:11:24.438917 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 291/578] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:23 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:25.463524 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-de2f75e2-cf64-456d-b194-0c11b5cb3084 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:25.466415 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-de2f75e2-cf64-456d-b194-0c11b5cb3084 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:25.479216 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-de2f75e2-cf64-456d-b194-0c11b5cb3084 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:25.482216 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-de2f75e2-cf64-456d-b194-0c11b5cb3084 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:25.485415 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-de2f75e2-cf64-456d-b194-0c11b5cb3084 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:25.486619 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-de2f75e2-cf64-456d-b194-0c11b5cb3084 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:25.752912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-de2f75e2-cf64-456d-b194-0c11b5cb3084 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:25.770498 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-de2f75e2-cf64-456d-b194-0c11b5cb3084 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:25.773994 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-de2f75e2-cf64-456d-b194-0c11b5cb3084 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:25.776333 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-de2f75e2-cf64-456d-b194-0c11b5cb3084 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.320445 Jun 16 18:11:25.777328 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 288/579] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:25 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:26.814955 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1a56240e-8832-4b94-ad31-020a19acd3b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:26.816342 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1a56240e-8832-4b94-ad31-020a19acd3b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:26.831683 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a56240e-8832-4b94-ad31-020a19acd3b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:26.832428 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a56240e-8832-4b94-ad31-020a19acd3b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:26.833258 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a56240e-8832-4b94-ad31-020a19acd3b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:26.833676 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a56240e-8832-4b94-ad31-020a19acd3b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:27.062564 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1a56240e-8832-4b94-ad31-020a19acd3b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:27.072782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1a56240e-8832-4b94-ad31-020a19acd3b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:27.074289 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1a56240e-8832-4b94-ad31-020a19acd3b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:27.076780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1a56240e-8832-4b94-ad31-020a19acd3b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.274041 Jun 16 18:11:27.077532 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 292/580] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:26 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:28.101933 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9c47c7e6-9243-443a-9e63-807046ffc568 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:28.103055 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9c47c7e6-9243-443a-9e63-807046ffc568 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:28.114040 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9c47c7e6-9243-443a-9e63-807046ffc568 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:28.114763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9c47c7e6-9243-443a-9e63-807046ffc568 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:28.115811 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9c47c7e6-9243-443a-9e63-807046ffc568 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:28.116484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9c47c7e6-9243-443a-9e63-807046ffc568 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:28.356988 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9c47c7e6-9243-443a-9e63-807046ffc568 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:28.367509 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9c47c7e6-9243-443a-9e63-807046ffc568 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:28.369239 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9c47c7e6-9243-443a-9e63-807046ffc568 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:28.377286 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9c47c7e6-9243-443a-9e63-807046ffc568 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.281850 Jun 16 18:11:28.378389 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 289/581] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:28 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:29.404810 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3224b400-166c-499f-b896-ab1d0aef629e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:29.407291 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3224b400-166c-499f-b896-ab1d0aef629e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:29.422926 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3224b400-166c-499f-b896-ab1d0aef629e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:29.424025 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3224b400-166c-499f-b896-ab1d0aef629e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:29.425292 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3224b400-166c-499f-b896-ab1d0aef629e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:29.426007 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3224b400-166c-499f-b896-ab1d0aef629e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:29.622502 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3224b400-166c-499f-b896-ab1d0aef629e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:29.626912 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:29.633095 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3224b400-166c-499f-b896-ab1d0aef629e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:29.648016 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3224b400-166c-499f-b896-ab1d0aef629e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:29.648016 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3224b400-166c-499f-b896-ab1d0aef629e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.241162 Jun 16 18:11:29.648016 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 293/582] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:29 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:30.659920 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b644eb93-e26d-41ea-9693-33241ec51f1a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:30.660979 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b644eb93-e26d-41ea-9693-33241ec51f1a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:30.670055 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b644eb93-e26d-41ea-9693-33241ec51f1a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:30.670502 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b644eb93-e26d-41ea-9693-33241ec51f1a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:30.671300 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b644eb93-e26d-41ea-9693-33241ec51f1a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:30.671758 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b644eb93-e26d-41ea-9693-33241ec51f1a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:30.833523 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b644eb93-e26d-41ea-9693-33241ec51f1a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:30.843552 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b644eb93-e26d-41ea-9693-33241ec51f1a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:30.845135 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b644eb93-e26d-41ea-9693-33241ec51f1a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:30.846378 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b644eb93-e26d-41ea-9693-33241ec51f1a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.194909 Jun 16 18:11:30.846934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 290/583] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:30 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:31.867756 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-16079248-f0f8-4c7f-9366-19773117f6aa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:31.868435 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-16079248-f0f8-4c7f-9366-19773117f6aa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:31.876547 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-16079248-f0f8-4c7f-9366-19773117f6aa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:31.876996 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-16079248-f0f8-4c7f-9366-19773117f6aa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:31.877771 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-16079248-f0f8-4c7f-9366-19773117f6aa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:31.878207 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-16079248-f0f8-4c7f-9366-19773117f6aa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:32.073132 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-16079248-f0f8-4c7f-9366-19773117f6aa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:32.080845 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-16079248-f0f8-4c7f-9366-19773117f6aa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:32.082644 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-16079248-f0f8-4c7f-9366-19773117f6aa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:32.083899 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-16079248-f0f8-4c7f-9366-19773117f6aa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.221779 Jun 16 18:11:32.084465 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 294/584] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:31 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:11:33.116016 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f7d5042c-24e4-46df-9a29-4b284542bca2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:33.116599 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f7d5042c-24e4-46df-9a29-4b284542bca2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:33.124163 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7d5042c-24e4-46df-9a29-4b284542bca2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:33.124619 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7d5042c-24e4-46df-9a29-4b284542bca2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:33.125412 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7d5042c-24e4-46df-9a29-4b284542bca2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:33.125843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7d5042c-24e4-46df-9a29-4b284542bca2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:33.275961 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f7d5042c-24e4-46df-9a29-4b284542bca2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:33.286294 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f7d5042c-24e4-46df-9a29-4b284542bca2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:33.289673 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f7d5042c-24e4-46df-9a29-4b284542bca2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:33.289673 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f7d5042c-24e4-46df-9a29-4b284542bca2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.177094 Jun 16 18:11:33.289673 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 291/585] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:33 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:34.310875 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9cd87103-c0c8-46d8-bf3d-289fb42fa591 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:34.311578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9cd87103-c0c8-46d8-bf3d-289fb42fa591 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:34.321326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9cd87103-c0c8-46d8-bf3d-289fb42fa591 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:34.321778 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9cd87103-c0c8-46d8-bf3d-289fb42fa591 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:34.322553 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9cd87103-c0c8-46d8-bf3d-289fb42fa591 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:34.322986 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9cd87103-c0c8-46d8-bf3d-289fb42fa591 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:34.471272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9cd87103-c0c8-46d8-bf3d-289fb42fa591 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:34.480301 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9cd87103-c0c8-46d8-bf3d-289fb42fa591 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:34.482501 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9cd87103-c0c8-46d8-bf3d-289fb42fa591 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:34.483794 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9cd87103-c0c8-46d8-bf3d-289fb42fa591 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.177972 Jun 16 18:11:34.484446 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 295/586] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:34 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:35.502431 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f0e49ae8-1ae2-4be7-aac3-51b8c4d36edc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:35.502953 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f0e49ae8-1ae2-4be7-aac3-51b8c4d36edc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:35.509556 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f0e49ae8-1ae2-4be7-aac3-51b8c4d36edc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:35.509999 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f0e49ae8-1ae2-4be7-aac3-51b8c4d36edc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:35.510755 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f0e49ae8-1ae2-4be7-aac3-51b8c4d36edc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:35.511189 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f0e49ae8-1ae2-4be7-aac3-51b8c4d36edc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:35.656107 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f0e49ae8-1ae2-4be7-aac3-51b8c4d36edc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:35.664726 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f0e49ae8-1ae2-4be7-aac3-51b8c4d36edc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:35.666210 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f0e49ae8-1ae2-4be7-aac3-51b8c4d36edc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:35.667347 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f0e49ae8-1ae2-4be7-aac3-51b8c4d36edc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.168989 Jun 16 18:11:35.667948 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 292/587] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:35 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:36.688267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-bb5004ba-1c4d-4529-a668-ebf14e6d7e98 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:36.688872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-bb5004ba-1c4d-4529-a668-ebf14e6d7e98 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:36.691336 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:36.696744 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bb5004ba-1c4d-4529-a668-ebf14e6d7e98 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:36.697184 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bb5004ba-1c4d-4529-a668-ebf14e6d7e98 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:36.697996 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bb5004ba-1c4d-4529-a668-ebf14e6d7e98 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:36.698433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bb5004ba-1c4d-4529-a668-ebf14e6d7e98 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:36.851163 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-bb5004ba-1c4d-4529-a668-ebf14e6d7e98 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:36.854969 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-bb5004ba-1c4d-4529-a668-ebf14e6d7e98 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:36.856593 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-bb5004ba-1c4d-4529-a668-ebf14e6d7e98 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:36.857857 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-bb5004ba-1c4d-4529-a668-ebf14e6d7e98 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.174387 Jun 16 18:11:36.858450 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 296/588] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:36 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:37.877272 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c5313873-d627-4687-8718-b0c674fc74b5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:37.877841 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c5313873-d627-4687-8718-b0c674fc74b5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:37.884644 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c5313873-d627-4687-8718-b0c674fc74b5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:37.885062 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c5313873-d627-4687-8718-b0c674fc74b5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:37.885840 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c5313873-d627-4687-8718-b0c674fc74b5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:37.886271 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c5313873-d627-4687-8718-b0c674fc74b5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:38.034016 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c5313873-d627-4687-8718-b0c674fc74b5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:38.043922 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c5313873-d627-4687-8718-b0c674fc74b5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:38.046728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c5313873-d627-4687-8718-b0c674fc74b5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:38.047962 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c5313873-d627-4687-8718-b0c674fc74b5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.175441 Jun 16 18:11:38.048526 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 293/589] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:37 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:38.502891 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-cb9b65d4-03c1-4e13-9825-312006703041 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:11:38.503853 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-cb9b65d4-03c1-4e13-9825-312006703041 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:38.510579 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cb9b65d4-03c1-4e13-9825-312006703041 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:38.511020 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cb9b65d4-03c1-4e13-9825-312006703041 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:38.511830 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cb9b65d4-03c1-4e13-9825-312006703041 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:38.512262 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cb9b65d4-03c1-4e13-9825-312006703041 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:38.538664 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-cb9b65d4-03c1-4e13-9825-312006703041 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lazy-loading 'flavor' on Instance uuid 1b2de096-32e0-4f4e-835d-4e3ba69263c9 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:11:39.066148 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-cb9b65d4-03c1-4e13-9825-312006703041 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "POST /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/action" status: 200 len: 32 microversion: 2.1 time: 0.567978 Jun 16 18:11:39.071033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 297/590] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:11:38 2022] POST /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/action => generated 32 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:11:39.074137 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9990caf6-4f93-4bfa-bdbf-225779ceb03f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:39.076373 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9990caf6-4f93-4bfa-bdbf-225779ceb03f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:39.077738 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-579bedd2-a777-4b62-9d2c-44b6ce7fffde tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:39.078439 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-579bedd2-a777-4b62-9d2c-44b6ce7fffde tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:39.084165 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9990caf6-4f93-4bfa-bdbf-225779ceb03f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:39.084771 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9990caf6-4f93-4bfa-bdbf-225779ceb03f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:39.085705 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9990caf6-4f93-4bfa-bdbf-225779ceb03f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:39.086340 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9990caf6-4f93-4bfa-bdbf-225779ceb03f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:39.086747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-579bedd2-a777-4b62-9d2c-44b6ce7fffde tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:39.087196 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-579bedd2-a777-4b62-9d2c-44b6ce7fffde tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:39.088475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-579bedd2-a777-4b62-9d2c-44b6ce7fffde tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:39.088608 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-579bedd2-a777-4b62-9d2c-44b6ce7fffde tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:39.309701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9990caf6-4f93-4bfa-bdbf-225779ceb03f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:39.318617 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-579bedd2-a777-4b62-9d2c-44b6ce7fffde tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:39.320689 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9990caf6-4f93-4bfa-bdbf-225779ceb03f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:39.322472 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9990caf6-4f93-4bfa-bdbf-225779ceb03f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:39.323746 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9990caf6-4f93-4bfa-bdbf-225779ceb03f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.256736 Jun 16 18:11:39.324540 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 294/591] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:39 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:39.332665 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-579bedd2-a777-4b62-9d2c-44b6ce7fffde tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.259792 Jun 16 18:11:39.333429 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 298/592] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:39 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:40.344100 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-39c696d6-c55d-48ef-848d-42e9ad0291e5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:40.344837 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-39c696d6-c55d-48ef-848d-42e9ad0291e5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:40.351093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-17dc348f-c73b-4657-a769-76f6946c77ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:40.351749 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-17dc348f-c73b-4657-a769-76f6946c77ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:40.355019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-39c696d6-c55d-48ef-848d-42e9ad0291e5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:40.355666 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-39c696d6-c55d-48ef-848d-42e9ad0291e5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:40.356521 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-39c696d6-c55d-48ef-848d-42e9ad0291e5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:40.357025 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-39c696d6-c55d-48ef-848d-42e9ad0291e5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:40.359518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-17dc348f-c73b-4657-a769-76f6946c77ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:40.360150 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-17dc348f-c73b-4657-a769-76f6946c77ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:40.360983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-17dc348f-c73b-4657-a769-76f6946c77ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:40.361488 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-17dc348f-c73b-4657-a769-76f6946c77ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:40.574605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-39c696d6-c55d-48ef-848d-42e9ad0291e5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:40.584079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-17dc348f-c73b-4657-a769-76f6946c77ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:40.584718 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-39c696d6-c55d-48ef-848d-42e9ad0291e5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:40.586256 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-39c696d6-c55d-48ef-848d-42e9ad0291e5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:40.587458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-39c696d6-c55d-48ef-848d-42e9ad0291e5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.248122 Jun 16 18:11:40.588018 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 295/593] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:40 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:40.594444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-17dc348f-c73b-4657-a769-76f6946c77ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.247446 Jun 16 18:11:40.595061 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 299/594] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:40 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:11:41.608230 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-66a417db-184c-4f31-b2a8-977f3d259aba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:41.608818 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-66a417db-184c-4f31-b2a8-977f3d259aba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:41.611390 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=42 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:41.612504 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3b83cf19-fd53-4cf9-add5-8f4a6c0320ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:41.613502 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3b83cf19-fd53-4cf9-add5-8f4a6c0320ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:41.617235 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-66a417db-184c-4f31-b2a8-977f3d259aba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:41.617676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-66a417db-184c-4f31-b2a8-977f3d259aba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:41.618443 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-66a417db-184c-4f31-b2a8-977f3d259aba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:41.618872 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-66a417db-184c-4f31-b2a8-977f3d259aba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:41.621196 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3b83cf19-fd53-4cf9-add5-8f4a6c0320ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:41.625916 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3b83cf19-fd53-4cf9-add5-8f4a6c0320ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:41.625916 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3b83cf19-fd53-4cf9-add5-8f4a6c0320ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:41.625916 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3b83cf19-fd53-4cf9-add5-8f4a6c0320ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:41.816486 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-66a417db-184c-4f31-b2a8-977f3d259aba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:41.825139 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-66a417db-184c-4f31-b2a8-977f3d259aba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:41.826892 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-66a417db-184c-4f31-b2a8-977f3d259aba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:41.828082 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-66a417db-184c-4f31-b2a8-977f3d259aba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.224538 Jun 16 18:11:41.829029 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 296/595] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:41 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:41.831466 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3b83cf19-fd53-4cf9-add5-8f4a6c0320ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:41.840104 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3b83cf19-fd53-4cf9-add5-8f4a6c0320ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.231593 Jun 16 18:11:41.840659 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 300/596] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:41 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:11:42.847306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ca54cc8f-dc12-4c6b-adaf-2cc5bba4d17c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:42.847929 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ca54cc8f-dc12-4c6b-adaf-2cc5bba4d17c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:42.854618 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ca54cc8f-dc12-4c6b-adaf-2cc5bba4d17c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:42.855060 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ca54cc8f-dc12-4c6b-adaf-2cc5bba4d17c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:42.855922 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ca54cc8f-dc12-4c6b-adaf-2cc5bba4d17c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:42.856284 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ca54cc8f-dc12-4c6b-adaf-2cc5bba4d17c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:42.858337 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d3063e33-29b1-4c80-a428-9d35fb904687 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:42.858951 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d3063e33-29b1-4c80-a428-9d35fb904687 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:42.865559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d3063e33-29b1-4c80-a428-9d35fb904687 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:42.865999 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d3063e33-29b1-4c80-a428-9d35fb904687 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:42.866766 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d3063e33-29b1-4c80-a428-9d35fb904687 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:42.867199 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d3063e33-29b1-4c80-a428-9d35fb904687 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:43.071803 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ca54cc8f-dc12-4c6b-adaf-2cc5bba4d17c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:43.079723 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d3063e33-29b1-4c80-a428-9d35fb904687 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:43.081516 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ca54cc8f-dc12-4c6b-adaf-2cc5bba4d17c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:43.083023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ca54cc8f-dc12-4c6b-adaf-2cc5bba4d17c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:43.084207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ca54cc8f-dc12-4c6b-adaf-2cc5bba4d17c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.241030 Jun 16 18:11:43.090064 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 297/597] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:42 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:43.090222 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d3063e33-29b1-4c80-a428-9d35fb904687 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.234077 Jun 16 18:11:43.090222 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 301/598] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:42 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:11:44.106236 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-06e5679d-dd62-4e82-84b4-b71d90c5d230 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:44.106784 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-06e5679d-dd62-4e82-84b4-b71d90c5d230 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:44.115518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06e5679d-dd62-4e82-84b4-b71d90c5d230 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:44.115945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06e5679d-dd62-4e82-84b4-b71d90c5d230 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:44.116696 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06e5679d-dd62-4e82-84b4-b71d90c5d230 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:44.117130 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06e5679d-dd62-4e82-84b4-b71d90c5d230 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:44.294658 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-06e5679d-dd62-4e82-84b4-b71d90c5d230 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:44.304153 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-06e5679d-dd62-4e82-84b4-b71d90c5d230 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.202156 Jun 16 18:11:44.305121 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 302/599] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:44 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:11:44.340061 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-4a228a98-09e6-4875-b8e9-851c27202bbd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:44.340687 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-4a228a98-09e6-4875-b8e9-851c27202bbd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:44.346718 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4a228a98-09e6-4875-b8e9-851c27202bbd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:44.347165 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4a228a98-09e6-4875-b8e9-851c27202bbd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:44.347964 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4a228a98-09e6-4875-b8e9-851c27202bbd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:44.348392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4a228a98-09e6-4875-b8e9-851c27202bbd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:44.505926 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4a228a98-09e6-4875-b8e9-851c27202bbd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:44.516811 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4a228a98-09e6-4875-b8e9-851c27202bbd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:44.518887 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4a228a98-09e6-4875-b8e9-851c27202bbd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:44.520382 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-4a228a98-09e6-4875-b8e9-851c27202bbd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.420242 Jun 16 18:11:44.521145 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 298/600] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:44 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:45.327037 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9e8d3966-1755-4558-b6d6-e1c45d45b78a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:45.327699 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9e8d3966-1755-4558-b6d6-e1c45d45b78a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:45.334084 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9e8d3966-1755-4558-b6d6-e1c45d45b78a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:45.334528 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9e8d3966-1755-4558-b6d6-e1c45d45b78a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:45.335286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9e8d3966-1755-4558-b6d6-e1c45d45b78a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:45.335742 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9e8d3966-1755-4558-b6d6-e1c45d45b78a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:45.477022 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9e8d3966-1755-4558-b6d6-e1c45d45b78a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:45.485968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9e8d3966-1755-4558-b6d6-e1c45d45b78a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.164430 Jun 16 18:11:45.486537 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 303/601] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:45 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:45.540998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9f1d3df0-6288-4dab-9bc2-c91ba0180e6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:45.541603 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9f1d3df0-6288-4dab-9bc2-c91ba0180e6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:45.549188 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f1d3df0-6288-4dab-9bc2-c91ba0180e6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:45.549633 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f1d3df0-6288-4dab-9bc2-c91ba0180e6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:45.550403 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f1d3df0-6288-4dab-9bc2-c91ba0180e6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:45.551171 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f1d3df0-6288-4dab-9bc2-c91ba0180e6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:45.695110 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9f1d3df0-6288-4dab-9bc2-c91ba0180e6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:45.704389 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9f1d3df0-6288-4dab-9bc2-c91ba0180e6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:45.705888 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9f1d3df0-6288-4dab-9bc2-c91ba0180e6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:45.707048 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9f1d3df0-6288-4dab-9bc2-c91ba0180e6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.170060 Jun 16 18:11:45.707642 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 299/602] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:45 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:46.123034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-6925dbde-3c60-4115-a0ea-8774a442ef0c req-53fd16e0-419e-4c3f-8674-f2e4bd54fb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279175ca-aad1-40da-a191-4712cbd17771", "name": "network-vif-plugged", "status": "completed", "tag": "d3e274fe-5d79-4687-9f75-5a8fd858ef61"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:11:46.133056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-6925dbde-3c60-4115-a0ea-8774a442ef0c req-53fd16e0-419e-4c3f-8674-f2e4bd54fb35 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:46.137521 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-6925dbde-3c60-4115-a0ea-8774a442ef0c req-53fd16e0-419e-4c3f-8674-f2e4bd54fb35 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:46.146257 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-6925dbde-3c60-4115-a0ea-8774a442ef0c req-53fd16e0-419e-4c3f-8674-f2e4bd54fb35 service nova] Creating event network-vif-plugged:d3e274fe-5d79-4687-9f75-5a8fd858ef61 for instance 279175ca-aad1-40da-a191-4712cbd17771 on hv-cinder-83754 Jun 16 18:11:46.151452 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-6925dbde-3c60-4115-a0ea-8774a442ef0c req-53fd16e0-419e-4c3f-8674-f2e4bd54fb35 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032303 Jun 16 18:11:46.152112 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 304/603] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:11:46.502751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-02e84ea9-eb8a-42ce-a170-b2faadf8beb1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:46.503269 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-02e84ea9-eb8a-42ce-a170-b2faadf8beb1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:46.509334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-02e84ea9-eb8a-42ce-a170-b2faadf8beb1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:46.509783 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-02e84ea9-eb8a-42ce-a170-b2faadf8beb1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:46.510539 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-02e84ea9-eb8a-42ce-a170-b2faadf8beb1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:46.510969 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-02e84ea9-eb8a-42ce-a170-b2faadf8beb1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:46.646588 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-02e84ea9-eb8a-42ce-a170-b2faadf8beb1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:46.655011 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-02e84ea9-eb8a-42ce-a170-b2faadf8beb1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.155931 Jun 16 18:11:46.655714 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 300/604] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:46 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:11:46.727239 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8bae5925-220e-4db3-953c-c5dcb8538d31 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:46.727966 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8bae5925-220e-4db3-953c-c5dcb8538d31 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:46.734828 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8bae5925-220e-4db3-953c-c5dcb8538d31 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:46.735274 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8bae5925-220e-4db3-953c-c5dcb8538d31 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:46.736171 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8bae5925-220e-4db3-953c-c5dcb8538d31 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:46.736615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8bae5925-220e-4db3-953c-c5dcb8538d31 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:46.879035 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8bae5925-220e-4db3-953c-c5dcb8538d31 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:46.887891 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8bae5925-220e-4db3-953c-c5dcb8538d31 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:46.889745 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8bae5925-220e-4db3-953c-c5dcb8538d31 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:46.890905 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8bae5925-220e-4db3-953c-c5dcb8538d31 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.168491 Jun 16 18:11:46.891792 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 305/605] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:46 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:47.673745 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2e13ef11-993f-48f6-9667-901cd91762f7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:47.674355 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2e13ef11-993f-48f6-9667-901cd91762f7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:47.681527 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e13ef11-993f-48f6-9667-901cd91762f7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:47.681959 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e13ef11-993f-48f6-9667-901cd91762f7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:47.682716 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e13ef11-993f-48f6-9667-901cd91762f7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:47.683140 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e13ef11-993f-48f6-9667-901cd91762f7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:47.822514 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2e13ef11-993f-48f6-9667-901cd91762f7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:47.831024 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2e13ef11-993f-48f6-9667-901cd91762f7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.162144 Jun 16 18:11:47.831646 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 301/606] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:47 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:47.910147 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dc11791c-dd66-4c52-bf79-a13c6f12929f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:47.910785 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-dc11791c-dd66-4c52-bf79-a13c6f12929f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:47.918763 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc11791c-dd66-4c52-bf79-a13c6f12929f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:47.919219 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc11791c-dd66-4c52-bf79-a13c6f12929f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:47.920797 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc11791c-dd66-4c52-bf79-a13c6f12929f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:47.921264 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dc11791c-dd66-4c52-bf79-a13c6f12929f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:48.065629 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dc11791c-dd66-4c52-bf79-a13c6f12929f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:48.074442 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dc11791c-dd66-4c52-bf79-a13c6f12929f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:48.075924 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dc11791c-dd66-4c52-bf79-a13c6f12929f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:48.077304 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-dc11791c-dd66-4c52-bf79-a13c6f12929f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.171164 Jun 16 18:11:48.077866 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 306/607] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:47 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:48.848516 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5d8419a0-1f9c-4fd9-a8ca-ea23bd5ace45 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:48.849135 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5d8419a0-1f9c-4fd9-a8ca-ea23bd5ace45 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:48.856422 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d8419a0-1f9c-4fd9-a8ca-ea23bd5ace45 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:48.856876 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d8419a0-1f9c-4fd9-a8ca-ea23bd5ace45 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:48.857659 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d8419a0-1f9c-4fd9-a8ca-ea23bd5ace45 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:48.858082 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d8419a0-1f9c-4fd9-a8ca-ea23bd5ace45 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:49.001200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5d8419a0-1f9c-4fd9-a8ca-ea23bd5ace45 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:49.005315 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:49.013686 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5d8419a0-1f9c-4fd9-a8ca-ea23bd5ace45 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.166046 Jun 16 18:11:49.013686 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 302/608] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:48 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:49.096784 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-7a1706d4-33ea-4463-9ee6-e66677bd92c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:49.097417 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-7a1706d4-33ea-4463-9ee6-e66677bd92c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:49.104884 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7a1706d4-33ea-4463-9ee6-e66677bd92c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:49.105255 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7a1706d4-33ea-4463-9ee6-e66677bd92c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:49.106032 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7a1706d4-33ea-4463-9ee6-e66677bd92c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:49.106462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7a1706d4-33ea-4463-9ee6-e66677bd92c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:49.263035 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7a1706d4-33ea-4463-9ee6-e66677bd92c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:49.271790 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7a1706d4-33ea-4463-9ee6-e66677bd92c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:49.273341 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7a1706d4-33ea-4463-9ee6-e66677bd92c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:49.274520 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-7a1706d4-33ea-4463-9ee6-e66677bd92c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.182651 Jun 16 18:11:49.275078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 307/609] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:49 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:50.028557 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-25babe00-3d0e-4620-a229-560e7aa720e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:50.029183 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-25babe00-3d0e-4620-a229-560e7aa720e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:50.039678 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-25babe00-3d0e-4620-a229-560e7aa720e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:50.040157 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-25babe00-3d0e-4620-a229-560e7aa720e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:50.041039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-25babe00-3d0e-4620-a229-560e7aa720e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:50.041581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-25babe00-3d0e-4620-a229-560e7aa720e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:50.208446 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-25babe00-3d0e-4620-a229-560e7aa720e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:50.218071 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-25babe00-3d0e-4620-a229-560e7aa720e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.193722 Jun 16 18:11:50.218662 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 303/610] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:50 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:50.294772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b8d80afa-fafb-4bd7-969b-3ff234b019d0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:50.295629 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b8d80afa-fafb-4bd7-969b-3ff234b019d0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:50.306411 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8d80afa-fafb-4bd7-969b-3ff234b019d0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:50.306865 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8d80afa-fafb-4bd7-969b-3ff234b019d0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:50.307672 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8d80afa-fafb-4bd7-969b-3ff234b019d0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:50.308114 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8d80afa-fafb-4bd7-969b-3ff234b019d0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:50.490995 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b8d80afa-fafb-4bd7-969b-3ff234b019d0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:50.502809 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b8d80afa-fafb-4bd7-969b-3ff234b019d0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:50.504603 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b8d80afa-fafb-4bd7-969b-3ff234b019d0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:50.506818 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b8d80afa-fafb-4bd7-969b-3ff234b019d0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.216785 Jun 16 18:11:50.507454 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 308/611] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:50 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:51.236629 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-de5e76fc-3421-4398-a26d-ad102931e5ef tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:51.237426 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-de5e76fc-3421-4398-a26d-ad102931e5ef tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:51.244130 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-de5e76fc-3421-4398-a26d-ad102931e5ef tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:51.244569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-de5e76fc-3421-4398-a26d-ad102931e5ef tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:51.245684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-de5e76fc-3421-4398-a26d-ad102931e5ef tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:51.245871 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-de5e76fc-3421-4398-a26d-ad102931e5ef tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:51.393435 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-de5e76fc-3421-4398-a26d-ad102931e5ef tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:51.401722 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-de5e76fc-3421-4398-a26d-ad102931e5ef tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.169653 Jun 16 18:11:51.402296 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 304/612] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:51 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:51.526450 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-55dd09f9-1fd5-4751-92fd-fe6fa1dee990 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:51.527057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-55dd09f9-1fd5-4751-92fd-fe6fa1dee990 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:51.533713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-55dd09f9-1fd5-4751-92fd-fe6fa1dee990 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:51.534158 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-55dd09f9-1fd5-4751-92fd-fe6fa1dee990 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:51.534904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-55dd09f9-1fd5-4751-92fd-fe6fa1dee990 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:51.535327 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-55dd09f9-1fd5-4751-92fd-fe6fa1dee990 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:51.539819 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:11:51.667229 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-55dd09f9-1fd5-4751-92fd-fe6fa1dee990 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:51.677435 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-55dd09f9-1fd5-4751-92fd-fe6fa1dee990 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:51.678942 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-55dd09f9-1fd5-4751-92fd-fe6fa1dee990 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:51.680248 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-55dd09f9-1fd5-4751-92fd-fe6fa1dee990 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1808 microversion: 2.20 time: 0.157687 Jun 16 18:11:51.680895 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 309/613] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:51 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:52.419678 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6f23cd6b-8e86-47b9-9681-41a97f1f9f29 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:52.420287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6f23cd6b-8e86-47b9-9681-41a97f1f9f29 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:52.427714 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f23cd6b-8e86-47b9-9681-41a97f1f9f29 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:52.428156 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f23cd6b-8e86-47b9-9681-41a97f1f9f29 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:52.428901 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f23cd6b-8e86-47b9-9681-41a97f1f9f29 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:52.429325 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f23cd6b-8e86-47b9-9681-41a97f1f9f29 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:52.566803 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6f23cd6b-8e86-47b9-9681-41a97f1f9f29 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:52.575222 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6f23cd6b-8e86-47b9-9681-41a97f1f9f29 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.159254 Jun 16 18:11:52.584318 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 305/614] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:52 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:52.698104 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1301329f-08ec-48ca-ae84-28987fffb0c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:52.698735 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1301329f-08ec-48ca-ae84-28987fffb0c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:52.706604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1301329f-08ec-48ca-ae84-28987fffb0c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:52.707055 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1301329f-08ec-48ca-ae84-28987fffb0c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:52.707865 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1301329f-08ec-48ca-ae84-28987fffb0c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:52.708299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1301329f-08ec-48ca-ae84-28987fffb0c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:52.842869 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1301329f-08ec-48ca-ae84-28987fffb0c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:52.851944 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1301329f-08ec-48ca-ae84-28987fffb0c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:52.853669 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1301329f-08ec-48ca-ae84-28987fffb0c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:52.855050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1301329f-08ec-48ca-ae84-28987fffb0c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1795 microversion: 2.20 time: 0.160856 Jun 16 18:11:52.855795 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 310/615] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:11:52 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1795 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:11:53.594183 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-52643889-50fb-4f46-8b08-d0d6b74dcc33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:53.594810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-52643889-50fb-4f46-8b08-d0d6b74dcc33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:53.601886 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-52643889-50fb-4f46-8b08-d0d6b74dcc33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:53.602332 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-52643889-50fb-4f46-8b08-d0d6b74dcc33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:53.603338 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-52643889-50fb-4f46-8b08-d0d6b74dcc33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:53.603573 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-52643889-50fb-4f46-8b08-d0d6b74dcc33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:53.748097 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-52643889-50fb-4f46-8b08-d0d6b74dcc33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:53.757288 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-52643889-50fb-4f46-8b08-d0d6b74dcc33 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.167754 Jun 16 18:11:53.757882 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 306/616] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:53 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:11:54.774194 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ee6306b7-e616-4ab7-a01b-578817c28895 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:54.774795 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ee6306b7-e616-4ab7-a01b-578817c28895 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:54.785398 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ee6306b7-e616-4ab7-a01b-578817c28895 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:54.786130 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ee6306b7-e616-4ab7-a01b-578817c28895 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:54.787381 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ee6306b7-e616-4ab7-a01b-578817c28895 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:54.788106 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ee6306b7-e616-4ab7-a01b-578817c28895 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:54.926176 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ee6306b7-e616-4ab7-a01b-578817c28895 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:54.935074 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ee6306b7-e616-4ab7-a01b-578817c28895 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.164781 Jun 16 18:11:54.935680 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 311/617] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:54 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:55.953690 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2cbb01e0-0b53-4837-bb6e-571ce88868e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:55.954333 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2cbb01e0-0b53-4837-bb6e-571ce88868e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:55.962932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2cbb01e0-0b53-4837-bb6e-571ce88868e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:55.963566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2cbb01e0-0b53-4837-bb6e-571ce88868e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:55.964558 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2cbb01e0-0b53-4837-bb6e-571ce88868e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:55.965130 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2cbb01e0-0b53-4837-bb6e-571ce88868e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:56.127832 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2cbb01e0-0b53-4837-bb6e-571ce88868e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:56.138532 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2cbb01e0-0b53-4837-bb6e-571ce88868e8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.188997 Jun 16 18:11:56.139166 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 307/618] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:55 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:57.157587 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-72c8eecc-8d1a-4a4c-8398-3484df3a43c7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:57.158181 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-72c8eecc-8d1a-4a4c-8398-3484df3a43c7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:57.166204 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-72c8eecc-8d1a-4a4c-8398-3484df3a43c7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:57.166652 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-72c8eecc-8d1a-4a4c-8398-3484df3a43c7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:57.167693 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-72c8eecc-8d1a-4a4c-8398-3484df3a43c7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:57.168137 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-72c8eecc-8d1a-4a4c-8398-3484df3a43c7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:57.320627 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-72c8eecc-8d1a-4a4c-8398-3484df3a43c7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:57.330458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-72c8eecc-8d1a-4a4c-8398-3484df3a43c7 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.177379 Jun 16 18:11:57.331057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 312/619] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:57 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:58.348746 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-859a9e50-8734-4a02-a46c-bfa39687ef91 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:58.349357 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-859a9e50-8734-4a02-a46c-bfa39687ef91 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:58.355978 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-859a9e50-8734-4a02-a46c-bfa39687ef91 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:58.356427 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-859a9e50-8734-4a02-a46c-bfa39687ef91 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:58.357284 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-859a9e50-8734-4a02-a46c-bfa39687ef91 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:58.357632 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-859a9e50-8734-4a02-a46c-bfa39687ef91 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:58.507244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-859a9e50-8734-4a02-a46c-bfa39687ef91 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:58.515661 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-859a9e50-8734-4a02-a46c-bfa39687ef91 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.170725 Jun 16 18:11:58.516230 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 308/620] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:58 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:11:59.532980 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-954f28d2-b1a2-48d9-b268-8e3284da0ba1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:11:59.533615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-954f28d2-b1a2-48d9-b268-8e3284da0ba1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:11:59.540543 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-954f28d2-b1a2-48d9-b268-8e3284da0ba1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:59.541023 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-954f28d2-b1a2-48d9-b268-8e3284da0ba1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:59.541792 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-954f28d2-b1a2-48d9-b268-8e3284da0ba1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:11:59.542223 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-954f28d2-b1a2-48d9-b268-8e3284da0ba1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:11:59.679662 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-954f28d2-b1a2-48d9-b268-8e3284da0ba1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:11:59.688712 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-954f28d2-b1a2-48d9-b268-8e3284da0ba1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1735 microversion: 2.1 time: 0.159678 Jun 16 18:11:59.689271 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 313/621] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:11:59 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:00.707881 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-403243b0-b345-4421-b001-5e7a3fe9a3c1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:00.708501 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-403243b0-b345-4421-b001-5e7a3fe9a3c1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:00.715171 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-403243b0-b345-4421-b001-5e7a3fe9a3c1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:00.715637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-403243b0-b345-4421-b001-5e7a3fe9a3c1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:00.716398 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-403243b0-b345-4421-b001-5e7a3fe9a3c1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:00.716823 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-403243b0-b345-4421-b001-5e7a3fe9a3c1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:00.854522 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-403243b0-b345-4421-b001-5e7a3fe9a3c1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:00.862480 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-403243b0-b345-4421-b001-5e7a3fe9a3c1 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1715 microversion: 2.1 time: 0.158776 Jun 16 18:12:00.863048 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 309/622] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:00 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:00.919211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-63f56514-e312-433f-a862-02108cf264ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:00.919788 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-63f56514-e312-433f-a862-02108cf264ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:00.926574 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-63f56514-e312-433f-a862-02108cf264ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:00.927010 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-63f56514-e312-433f-a862-02108cf264ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:00.928077 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-63f56514-e312-433f-a862-02108cf264ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:00.928526 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-63f56514-e312-433f-a862-02108cf264ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:01.060378 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-63f56514-e312-433f-a862-02108cf264ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] HTTP exception thrown: Cannot 'detach_volume' instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 while it is in vm_state rescued Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-63f56514-e312-433f-a862-02108cf264ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Request method failure captured: Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: DELETE /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments/940d64c2-2d78-4026-99c2-03ce75dfa643 HTTP/1.1 Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3Eq-J0cdT7Q59NKUoZ9-m6io95jrja4nBlLZ2IrmHPjQUc437edozQeIknUqxjH4oxU4tdk87XU_tl9vD01b67d4jh_u74_xK6DIe9tZ4bSiOiMPWaTlez9oD4PgPfEkuLcgt5L68flaxEHxw0SGv-tm0UCwE2jS56Nebwkx8ox4Bg Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: b566750533af4d0d96a3d0e0ffbc45ed Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:12:01.062079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:12:01.063584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:12:01.063584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:12:01.063584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: b566750533af4d0d96a3d0e0ffbc45ed Jun 16 18:12:01.063584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:12:01.063584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-ServerRescueNegativeTestJSON-1069596980-project Jun 16 18:12:01.063584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:12:01.063584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:12:01.063584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 70d6f15465b84182a28d96d1808a9660 Jun 16 18:12:01.063584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1069596980-project Jun 16 18:12:01.063584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:12:01.063584 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Cannot 'detach_volume' instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 while it is in vm_state rescued Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'server_id': '1b2de096-32e0-4f4e-835d-4e3ba69263c9', 'id': '940d64c2-2d78-4026-99c2-03ce75dfa643'} Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:12:01.064298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 while it is in vm_state rescued Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 while it is in vm_state rescued Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:12:01.065613 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-63f56514-e312-433f-a862-02108cf264ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Returning 409 to user: Cannot 'detach_volume' instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 while it is in vm_state rescued {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:12:01.066608 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-63f56514-e312-433f-a862-02108cf264ca tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments/940d64c2-2d78-4026-99c2-03ce75dfa643" status: 409 len: 152 microversion: 2.1 time: 0.148492 Jun 16 18:12:01.066608 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 314/623] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jun 16 18:12:00 2022] DELETE /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments/940d64c2-2d78-4026-99c2-03ce75dfa643 => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:12:01.072863 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-22b5bf75-8e88-44f0-b505-f03cb30e146c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:12:01.073416 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-22b5bf75-8e88-44f0-b505-f03cb30e146c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:01.080321 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-22b5bf75-8e88-44f0-b505-f03cb30e146c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:01.080769 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-22b5bf75-8e88-44f0-b505-f03cb30e146c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:01.081719 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-22b5bf75-8e88-44f0-b505-f03cb30e146c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:01.082231 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-22b5bf75-8e88-44f0-b505-f03cb30e146c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:01.493548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-22b5bf75-8e88-44f0-b505-f03cb30e146c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "POST /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/action" status: 202 len: 0 microversion: 2.1 time: 0.424446 Jun 16 18:12:01.494373 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 310/624] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:12:01 2022] POST /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:12:01.504963 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1d376615-c3aa-4a83-9e63-3e7aa3863745 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:01.505501 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1d376615-c3aa-4a83-9e63-3e7aa3863745 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:01.512324 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1d376615-c3aa-4a83-9e63-3e7aa3863745 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:01.515916 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1d376615-c3aa-4a83-9e63-3e7aa3863745 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:01.515916 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1d376615-c3aa-4a83-9e63-3e7aa3863745 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:01.515916 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1d376615-c3aa-4a83-9e63-3e7aa3863745 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:01.660461 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1d376615-c3aa-4a83-9e63-3e7aa3863745 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:01.669251 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1d376615-c3aa-4a83-9e63-3e7aa3863745 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1723 microversion: 2.1 time: 0.168631 Jun 16 18:12:01.669900 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 315/625] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:01 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:02.690123 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ecfc3592-43c7-49d7-a77e-4dc5c6854813 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:02.690829 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ecfc3592-43c7-49d7-a77e-4dc5c6854813 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:02.697480 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ecfc3592-43c7-49d7-a77e-4dc5c6854813 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:02.697985 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ecfc3592-43c7-49d7-a77e-4dc5c6854813 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:02.698764 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ecfc3592-43c7-49d7-a77e-4dc5c6854813 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:02.699194 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ecfc3592-43c7-49d7-a77e-4dc5c6854813 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:02.848543 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ecfc3592-43c7-49d7-a77e-4dc5c6854813 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:02.857178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ecfc3592-43c7-49d7-a77e-4dc5c6854813 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1723 microversion: 2.1 time: 0.172314 Jun 16 18:12:02.857812 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 311/626] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:02 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:12:03.874720 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6fbc0b9f-d3a0-40e2-a5f6-97455cf23a93 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:03.875444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6fbc0b9f-d3a0-40e2-a5f6-97455cf23a93 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:03.882117 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6fbc0b9f-d3a0-40e2-a5f6-97455cf23a93 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:03.882694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6fbc0b9f-d3a0-40e2-a5f6-97455cf23a93 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:03.883576 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6fbc0b9f-d3a0-40e2-a5f6-97455cf23a93 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:03.884055 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6fbc0b9f-d3a0-40e2-a5f6-97455cf23a93 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:04.053940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6fbc0b9f-d3a0-40e2-a5f6-97455cf23a93 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:04.062588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6fbc0b9f-d3a0-40e2-a5f6-97455cf23a93 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1723 microversion: 2.1 time: 0.191638 Jun 16 18:12:04.063155 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 316/627] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:03 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:05.080649 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-58b4839f-0c0d-4781-8cc0-af29e53d2c46 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:05.081458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-58b4839f-0c0d-4781-8cc0-af29e53d2c46 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:05.088813 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-58b4839f-0c0d-4781-8cc0-af29e53d2c46 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:05.089527 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-58b4839f-0c0d-4781-8cc0-af29e53d2c46 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:05.090419 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-58b4839f-0c0d-4781-8cc0-af29e53d2c46 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:05.090864 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-58b4839f-0c0d-4781-8cc0-af29e53d2c46 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:05.256349 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-58b4839f-0c0d-4781-8cc0-af29e53d2c46 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:05.265737 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-58b4839f-0c0d-4781-8cc0-af29e53d2c46 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1723 microversion: 2.1 time: 0.188486 Jun 16 18:12:05.266910 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 312/628] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:05 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:12:06.284846 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0240b422-65a4-4884-910a-32ce07cc8533 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:06.285503 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0240b422-65a4-4884-910a-32ce07cc8533 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:06.293012 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0240b422-65a4-4884-910a-32ce07cc8533 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:06.293456 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0240b422-65a4-4884-910a-32ce07cc8533 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:06.294241 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0240b422-65a4-4884-910a-32ce07cc8533 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:06.294679 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0240b422-65a4-4884-910a-32ce07cc8533 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:06.432110 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0240b422-65a4-4884-910a-32ce07cc8533 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:06.443253 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0240b422-65a4-4884-910a-32ce07cc8533 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1729 microversion: 2.1 time: 0.162571 Jun 16 18:12:06.443888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 317/629] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:06 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:06.460583 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0ceb7270-7f60-4a44-ba28-78a5c6b540a3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:06.461396 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0ceb7270-7f60-4a44-ba28-78a5c6b540a3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:06.468200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0ceb7270-7f60-4a44-ba28-78a5c6b540a3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:06.469176 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0ceb7270-7f60-4a44-ba28-78a5c6b540a3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:06.469947 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0ceb7270-7f60-4a44-ba28-78a5c6b540a3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:06.470384 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0ceb7270-7f60-4a44-ba28-78a5c6b540a3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:06.557360 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0ceb7270-7f60-4a44-ba28-78a5c6b540a3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100693 Jun 16 18:12:06.557945 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 313/630] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jun 16 18:12:06 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:12:07.743628 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-462063de-5659-4612-bc20-9915fbaacf31 req-45417bd0-57f4-4d45-8312-6c0a5bd9db4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2de096-32e0-4f4e-835d-4e3ba69263c9", "tag": "b98b0ab2-3cdd-47a1-b37c-1d29f9464d66"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:12:07.752267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-462063de-5659-4612-bc20-9915fbaacf31 req-45417bd0-57f4-4d45-8312-6c0a5bd9db4f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:07.752706 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-462063de-5659-4612-bc20-9915fbaacf31 req-45417bd0-57f4-4d45-8312-6c0a5bd9db4f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:07.764702 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-462063de-5659-4612-bc20-9915fbaacf31 req-45417bd0-57f4-4d45-8312-6c0a5bd9db4f service nova] Creating event network-changed:b98b0ab2-3cdd-47a1-b37c-1d29f9464d66 for instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 on hv-cinder-83754 Jun 16 18:12:07.770620 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-462063de-5659-4612-bc20-9915fbaacf31 req-45417bd0-57f4-4d45-8312-6c0a5bd9db4f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119294 Jun 16 18:12:07.771745 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 318/631] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:12:09.787103 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-60bb2e29-af0b-49d8-bfd8-9379605e7556 req-4c0afb1f-0edb-4a2a-a9ef-c679c686409a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2de096-32e0-4f4e-835d-4e3ba69263c9", "tag": "b98b0ab2-3cdd-47a1-b37c-1d29f9464d66"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:12:09.795923 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-60bb2e29-af0b-49d8-bfd8-9379605e7556 req-4c0afb1f-0edb-4a2a-a9ef-c679c686409a service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:09.796378 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-60bb2e29-af0b-49d8-bfd8-9379605e7556 req-4c0afb1f-0edb-4a2a-a9ef-c679c686409a service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:09.811007 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-60bb2e29-af0b-49d8-bfd8-9379605e7556 req-4c0afb1f-0edb-4a2a-a9ef-c679c686409a service nova] Creating event network-changed:b98b0ab2-3cdd-47a1-b37c-1d29f9464d66 for instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 on hv-cinder-83754 Jun 16 18:12:09.817331 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-60bb2e29-af0b-49d8-bfd8-9379605e7556 req-4c0afb1f-0edb-4a2a-a9ef-c679c686409a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034086 Jun 16 18:12:09.817985 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 314/632] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:12:13.116838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8c2767a7-69bc-49a4-9726-026dd5565b07 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:13.117463 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8c2767a7-69bc-49a4-9726-026dd5565b07 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:13.119417 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=46 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:12:13.124732 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8c2767a7-69bc-49a4-9726-026dd5565b07 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:13.125932 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8c2767a7-69bc-49a4-9726-026dd5565b07 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:13.126882 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8c2767a7-69bc-49a4-9726-026dd5565b07 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:13.127323 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8c2767a7-69bc-49a4-9726-026dd5565b07 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:13.218558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-8c2767a7-69bc-49a4-9726-026dd5565b07 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lazy-loading 'services' on Instance uuid 1134706f-4520-434d-877f-bc6465b3e282 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:12:13.777199 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8c2767a7-69bc-49a4-9726-026dd5565b07 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/os-volume_attachments/1df85a5e-c0d9-4dbb-ab8c-7187b171b17a" status: 202 len: 0 microversion: 2.1 time: 0.799524 Jun 16 18:12:13.777809 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 319/633] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jun 16 18:12:12 2022] DELETE /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/os-volume_attachments/1df85a5e-c0d9-4dbb-ab8c-7187b171b17a => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:12:16.050025 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0007d3db-d7d5-430e-9123-d9ee4fea1e5b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:12:16.052385 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=38 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:12:16.058206 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0007d3db-d7d5-430e-9123-d9ee4fea1e5b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:16.062290 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0007d3db-d7d5-430e-9123-d9ee4fea1e5b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:16.084883 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0007d3db-d7d5-430e-9123-d9ee4fea1e5b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Going to try to stop instance {{(pid=118161) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:12:16.404172 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0007d3db-d7d5-430e-9123-d9ee4fea1e5b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "POST /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/action" status: 202 len: 0 microversion: 2.1 time: 0.358857 Jun 16 18:12:16.404802 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 315/634] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:12:16 2022] POST /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:12:16.415933 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-497f03ec-d4b5-4340-9e90-b12cba9d10c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:16.416642 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-497f03ec-d4b5-4340-9e90-b12cba9d10c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:16.423724 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-497f03ec-d4b5-4340-9e90-b12cba9d10c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:16.426219 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-497f03ec-d4b5-4340-9e90-b12cba9d10c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:16.426219 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-497f03ec-d4b5-4340-9e90-b12cba9d10c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:16.426219 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-497f03ec-d4b5-4340-9e90-b12cba9d10c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:16.575265 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-497f03ec-d4b5-4340-9e90-b12cba9d10c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:16.585102 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-497f03ec-d4b5-4340-9e90-b12cba9d10c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.174550 Jun 16 18:12:16.585687 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 320/635] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:16 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:17.604698 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2e7dd55f-39c5-4782-9cfd-b71421c6661c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:17.605298 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2e7dd55f-39c5-4782-9cfd-b71421c6661c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:17.612614 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e7dd55f-39c5-4782-9cfd-b71421c6661c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:17.613055 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e7dd55f-39c5-4782-9cfd-b71421c6661c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:17.613833 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e7dd55f-39c5-4782-9cfd-b71421c6661c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:17.614265 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e7dd55f-39c5-4782-9cfd-b71421c6661c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:17.749845 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2e7dd55f-39c5-4782-9cfd-b71421c6661c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:17.758501 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2e7dd55f-39c5-4782-9cfd-b71421c6661c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.158803 Jun 16 18:12:17.759104 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 316/636] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:17 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:18.776667 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-adc6da07-2f75-4372-9b97-7e77423ee461 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:18.777276 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-adc6da07-2f75-4372-9b97-7e77423ee461 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:18.784716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-adc6da07-2f75-4372-9b97-7e77423ee461 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:18.785162 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-adc6da07-2f75-4372-9b97-7e77423ee461 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:18.785924 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-adc6da07-2f75-4372-9b97-7e77423ee461 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:18.786354 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-adc6da07-2f75-4372-9b97-7e77423ee461 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:18.924580 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-adc6da07-2f75-4372-9b97-7e77423ee461 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:18.932831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-adc6da07-2f75-4372-9b97-7e77423ee461 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.160111 Jun 16 18:12:18.933319 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 321/637] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:18 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:19.950543 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-280f3c80-1116-492f-88e4-5c75f55dce5e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:19.951135 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-280f3c80-1116-492f-88e4-5c75f55dce5e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:19.957904 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-280f3c80-1116-492f-88e4-5c75f55dce5e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:19.958350 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-280f3c80-1116-492f-88e4-5c75f55dce5e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:19.959117 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-280f3c80-1116-492f-88e4-5c75f55dce5e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:19.959606 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-280f3c80-1116-492f-88e4-5c75f55dce5e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:20.090370 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-280f3c80-1116-492f-88e4-5c75f55dce5e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:20.098691 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-280f3c80-1116-492f-88e4-5c75f55dce5e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.152125 Jun 16 18:12:20.099263 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 317/638] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:19 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:21.116799 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f8368ef5-f7cb-4e7a-be1c-416adb9238d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:21.117370 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f8368ef5-f7cb-4e7a-be1c-416adb9238d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:21.123921 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f8368ef5-f7cb-4e7a-be1c-416adb9238d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:21.124397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f8368ef5-f7cb-4e7a-be1c-416adb9238d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:21.125230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f8368ef5-f7cb-4e7a-be1c-416adb9238d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:21.125825 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f8368ef5-f7cb-4e7a-be1c-416adb9238d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:21.262061 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f8368ef5-f7cb-4e7a-be1c-416adb9238d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:21.270511 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f8368ef5-f7cb-4e7a-be1c-416adb9238d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.157719 Jun 16 18:12:21.271080 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 322/639] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:21 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:22.287110 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1c273a10-2cc8-4141-9f2b-9c521609798b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:22.287738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1c273a10-2cc8-4141-9f2b-9c521609798b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:22.294477 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c273a10-2cc8-4141-9f2b-9c521609798b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:22.294927 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c273a10-2cc8-4141-9f2b-9c521609798b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:22.295790 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c273a10-2cc8-4141-9f2b-9c521609798b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:22.296223 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c273a10-2cc8-4141-9f2b-9c521609798b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:22.299564 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:12:22.439400 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1c273a10-2cc8-4141-9f2b-9c521609798b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:22.446825 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1c273a10-2cc8-4141-9f2b-9c521609798b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.163617 Jun 16 18:12:22.447400 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 318/640] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:22 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:23.465210 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f0385485-69ef-4263-9a40-cb069797f3c2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:23.465803 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f0385485-69ef-4263-9a40-cb069797f3c2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:23.472779 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f0385485-69ef-4263-9a40-cb069797f3c2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:23.473349 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f0385485-69ef-4263-9a40-cb069797f3c2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:23.474160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f0385485-69ef-4263-9a40-cb069797f3c2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:23.474632 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f0385485-69ef-4263-9a40-cb069797f3c2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:23.477431 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:12:23.613974 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f0385485-69ef-4263-9a40-cb069797f3c2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:23.621987 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f0385485-69ef-4263-9a40-cb069797f3c2 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.160658 Jun 16 18:12:23.622558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 323/641] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:23 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:24.641186 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3034c204-229c-49a0-8841-bf6f7aa74a5c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:24.642529 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3034c204-229c-49a0-8841-bf6f7aa74a5c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:24.649494 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3034c204-229c-49a0-8841-bf6f7aa74a5c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:24.650222 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3034c204-229c-49a0-8841-bf6f7aa74a5c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:24.650734 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3034c204-229c-49a0-8841-bf6f7aa74a5c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:24.651161 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3034c204-229c-49a0-8841-bf6f7aa74a5c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:24.807940 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3034c204-229c-49a0-8841-bf6f7aa74a5c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:24.817900 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3034c204-229c-49a0-8841-bf6f7aa74a5c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.181029 Jun 16 18:12:24.818498 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 319/642] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:24 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:25.837603 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3044e59c-27c6-4f9f-83d1-5ef78c5be3da tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:25.838486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3044e59c-27c6-4f9f-83d1-5ef78c5be3da tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:25.846393 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3044e59c-27c6-4f9f-83d1-5ef78c5be3da tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:25.846845 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3044e59c-27c6-4f9f-83d1-5ef78c5be3da tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:25.847667 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3044e59c-27c6-4f9f-83d1-5ef78c5be3da tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:25.848106 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3044e59c-27c6-4f9f-83d1-5ef78c5be3da tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:25.983752 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3044e59c-27c6-4f9f-83d1-5ef78c5be3da tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:25.992253 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3044e59c-27c6-4f9f-83d1-5ef78c5be3da tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.160287 Jun 16 18:12:25.992813 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 324/643] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:25 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:27.010289 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-65cd3313-3abe-41e5-bf7b-94d8be5bbdb6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:27.010900 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-65cd3313-3abe-41e5-bf7b-94d8be5bbdb6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:27.018175 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-65cd3313-3abe-41e5-bf7b-94d8be5bbdb6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:27.018614 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-65cd3313-3abe-41e5-bf7b-94d8be5bbdb6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:27.019391 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-65cd3313-3abe-41e5-bf7b-94d8be5bbdb6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:27.019817 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-65cd3313-3abe-41e5-bf7b-94d8be5bbdb6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:27.156598 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-65cd3313-3abe-41e5-bf7b-94d8be5bbdb6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:27.170861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-65cd3313-3abe-41e5-bf7b-94d8be5bbdb6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.164340 Jun 16 18:12:27.171472 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 320/644] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:27 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:28.190226 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-493420eb-a494-4bd1-b786-43d5b1c14b17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:28.191803 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-493420eb-a494-4bd1-b786-43d5b1c14b17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:28.197466 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-493420eb-a494-4bd1-b786-43d5b1c14b17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:28.197846 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-493420eb-a494-4bd1-b786-43d5b1c14b17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:28.199027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-493420eb-a494-4bd1-b786-43d5b1c14b17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:28.199543 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-493420eb-a494-4bd1-b786-43d5b1c14b17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:28.364792 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-493420eb-a494-4bd1-b786-43d5b1c14b17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:28.380527 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-493420eb-a494-4bd1-b786-43d5b1c14b17 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.194405 Jun 16 18:12:28.381124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 325/645] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:28 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:29.402517 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d306e062-4122-4e9b-96e5-b166788b31d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:29.403595 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d306e062-4122-4e9b-96e5-b166788b31d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:29.414723 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d306e062-4122-4e9b-96e5-b166788b31d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:29.415480 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d306e062-4122-4e9b-96e5-b166788b31d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:29.416745 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d306e062-4122-4e9b-96e5-b166788b31d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:29.417474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d306e062-4122-4e9b-96e5-b166788b31d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:29.560684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d306e062-4122-4e9b-96e5-b166788b31d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:29.568922 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d306e062-4122-4e9b-96e5-b166788b31d4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.173247 Jun 16 18:12:29.569491 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 321/646] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:29 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:30.586263 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f2b10c15-9a55-4c1e-ab58-c9f606659564 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:30.586915 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f2b10c15-9a55-4c1e-ab58-c9f606659564 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:30.593529 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f2b10c15-9a55-4c1e-ab58-c9f606659564 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:30.593973 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f2b10c15-9a55-4c1e-ab58-c9f606659564 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:30.594739 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f2b10c15-9a55-4c1e-ab58-c9f606659564 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:30.595833 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f2b10c15-9a55-4c1e-ab58-c9f606659564 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:30.730992 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f2b10c15-9a55-4c1e-ab58-c9f606659564 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:30.739997 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f2b10c15-9a55-4c1e-ab58-c9f606659564 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.157719 Jun 16 18:12:30.740965 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 326/647] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:30 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:31.757513 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5eb13451-a650-4440-89d3-610b1997c7fe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:31.758173 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5eb13451-a650-4440-89d3-610b1997c7fe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:31.764687 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5eb13451-a650-4440-89d3-610b1997c7fe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:31.765128 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5eb13451-a650-4440-89d3-610b1997c7fe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:31.765884 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5eb13451-a650-4440-89d3-610b1997c7fe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:31.766308 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5eb13451-a650-4440-89d3-610b1997c7fe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:31.902431 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5eb13451-a650-4440-89d3-610b1997c7fe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:31.910855 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5eb13451-a650-4440-89d3-610b1997c7fe tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1676 microversion: 2.1 time: 0.157222 Jun 16 18:12:31.911446 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 322/648] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:31 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:32.928445 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-59aa10e6-22cd-41ef-b8b4-d797a352d5d1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:32.929037 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-59aa10e6-22cd-41ef-b8b4-d797a352d5d1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:32.935968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-59aa10e6-22cd-41ef-b8b4-d797a352d5d1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:32.936416 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-59aa10e6-22cd-41ef-b8b4-d797a352d5d1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:32.937195 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-59aa10e6-22cd-41ef-b8b4-d797a352d5d1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:32.937623 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-59aa10e6-22cd-41ef-b8b4-d797a352d5d1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:33.076818 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-59aa10e6-22cd-41ef-b8b4-d797a352d5d1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:33.087596 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-59aa10e6-22cd-41ef-b8b4-d797a352d5d1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1653 microversion: 2.1 time: 0.162976 Jun 16 18:12:33.088364 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 327/649] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:32 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:33.107704 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-88e396be-d615-4367-8963-f3d3a9316403 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:12:33.116444 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-88e396be-d615-4367-8963-f3d3a9316403 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:33.116886 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-88e396be-d615-4367-8963-f3d3a9316403 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:33.147543 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-88e396be-d615-4367-8963-f3d3a9316403 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Going to try to start instance {{(pid=118161) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 18:12:33.462584 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-88e396be-d615-4367-8963-f3d3a9316403 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "POST /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/action" status: 202 len: 0 microversion: 2.1 time: 0.359691 Jun 16 18:12:33.465973 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 323/650] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:12:33 2022] POST /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:12:33.472580 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-36bf6c1f-6cdb-4585-ae70-dbd7c026d676 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:33.473301 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-36bf6c1f-6cdb-4585-ae70-dbd7c026d676 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:33.479639 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-36bf6c1f-6cdb-4585-ae70-dbd7c026d676 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:33.480093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-36bf6c1f-6cdb-4585-ae70-dbd7c026d676 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:33.480875 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-36bf6c1f-6cdb-4585-ae70-dbd7c026d676 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:33.481319 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-36bf6c1f-6cdb-4585-ae70-dbd7c026d676 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:33.620734 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-36bf6c1f-6cdb-4585-ae70-dbd7c026d676 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:33.629150 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-36bf6c1f-6cdb-4585-ae70-dbd7c026d676 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1662 microversion: 2.1 time: 0.161341 Jun 16 18:12:33.629715 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 328/651] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:33 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:34.648691 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b30c678c-c0c1-4c43-991e-5d654e8b0e7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:34.649396 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b30c678c-c0c1-4c43-991e-5d654e8b0e7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:34.655754 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b30c678c-c0c1-4c43-991e-5d654e8b0e7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:34.656200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b30c678c-c0c1-4c43-991e-5d654e8b0e7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:34.656975 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b30c678c-c0c1-4c43-991e-5d654e8b0e7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:34.657409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b30c678c-c0c1-4c43-991e-5d654e8b0e7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:34.804111 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b30c678c-c0c1-4c43-991e-5d654e8b0e7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:34.812562 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b30c678c-c0c1-4c43-991e-5d654e8b0e7c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1662 microversion: 2.1 time: 0.168556 Jun 16 18:12:34.813136 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 324/652] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:34 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:34.893943 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-cec06524-da13-4d3f-a45b-c5ae0c2baf8b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:34.894535 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-cec06524-da13-4d3f-a45b-c5ae0c2baf8b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:34.901350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cec06524-da13-4d3f-a45b-c5ae0c2baf8b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:34.901350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cec06524-da13-4d3f-a45b-c5ae0c2baf8b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:34.902049 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cec06524-da13-4d3f-a45b-c5ae0c2baf8b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:34.902492 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cec06524-da13-4d3f-a45b-c5ae0c2baf8b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:34.926769 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-cec06524-da13-4d3f-a45b-c5ae0c2baf8b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c/ips" status: 200 len: 150 microversion: 2.1 time: 0.149189 Jun 16 18:12:34.927287 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 329/653] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jun 16 18:12:34 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c/ips => generated 150 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:12:34.938195 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1b501fd7-57bd-4fec-92e2-3cb9ec6777b3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aea07d3e-d5e1-4df1-8c9a-818559cb5782"}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:12:34.944215 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1b501fd7-57bd-4fec-92e2-3cb9ec6777b3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:34.946531 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1b501fd7-57bd-4fec-92e2-3cb9ec6777b3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:34.946975 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1b501fd7-57bd-4fec-92e2-3cb9ec6777b3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:34.947804 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1b501fd7-57bd-4fec-92e2-3cb9ec6777b3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:34.948234 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1b501fd7-57bd-4fec-92e2-3cb9ec6777b3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:35.029297 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-1b501fd7-57bd-4fec-92e2-3cb9ec6777b3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Invalid volume: volume aea07d3e-d5e1-4df1-8c9a-818559cb5782 is already attached to instances: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1b501fd7-57bd-4fec-92e2-3cb9ec6777b3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: POST /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c/os-volume_attachments HTTP/1.1 Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 74 Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:12:35.031023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:12:35.032697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:12:35.032697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:12:35.032697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:12:35.032697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:12:35.032697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:12:35.032697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:12:35.032697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:12:35.032697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:12:35.032697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:12:35.032697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Jun 16 18:12:35.032697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {"volumeAttachment": {"volumeId": "aea07d3e-d5e1-4df1-8c9a-818559cb5782"}} Jun 16 18:12:35.032697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Invalid volume: volume aea07d3e-d5e1-4df1-8c9a-818559cb5782 is already attached to instances: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'server_id': '3a820253-c5ce-455d-9bf7-ded303efc37c', 'body': {'volumeAttachment': {'volumeId': 'aea07d3e-d5e1-4df1-8c9a-818559cb5782'}}} Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aea07d3e-d5e1-4df1-8c9a-818559cb5782 is already attached to instances: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:12:35.033856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aea07d3e-d5e1-4df1-8c9a-818559cb5782 is already attached to instances: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:12:35.035409 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:12:35.040781 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:12:35.040781 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:12:35.040781 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:12:35.040781 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aea07d3e-d5e1-4df1-8c9a-818559cb5782 is already attached to instances: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e Jun 16 18:12:35.040781 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:12:35.040781 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1b501fd7-57bd-4fec-92e2-3cb9ec6777b3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 400 to user: Invalid volume: volume aea07d3e-d5e1-4df1-8c9a-818559cb5782 is already attached to instances: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:12:35.040781 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1b501fd7-57bd-4fec-92e2-3cb9ec6777b3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098450 Jun 16 18:12:35.040781 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 325/654] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:12:34 2022] POST /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:12:35.041929 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-48590f12-9513-45d6-8abd-58344b8df5e0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:35.042445 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-48590f12-9513-45d6-8abd-58344b8df5e0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:35.049309 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-48590f12-9513-45d6-8abd-58344b8df5e0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:35.049755 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-48590f12-9513-45d6-8abd-58344b8df5e0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:35.051059 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-48590f12-9513-45d6-8abd-58344b8df5e0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:35.051267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-48590f12-9513-45d6-8abd-58344b8df5e0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:35.077538 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-48590f12-9513-45d6-8abd-58344b8df5e0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Going to try to terminate instance {{(pid=118162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:12:35.471040 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-48590f12-9513-45d6-8abd-58344b8df5e0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 204 len: 0 microversion: 2.1 time: 0.432730 Jun 16 18:12:35.472071 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 330/655] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:12:35 2022] DELETE /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:12:35.482467 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7edab996-0ece-49d1-a705-c67496cb46cb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:35.483600 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7edab996-0ece-49d1-a705-c67496cb46cb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:35.494808 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7edab996-0ece-49d1-a705-c67496cb46cb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:35.495582 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7edab996-0ece-49d1-a705-c67496cb46cb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:35.496547 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7edab996-0ece-49d1-a705-c67496cb46cb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:35.497055 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7edab996-0ece-49d1-a705-c67496cb46cb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:35.831351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6294043d-cbfe-4794-a76c-01bb6bec8fa8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:35.832209 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6294043d-cbfe-4794-a76c-01bb6bec8fa8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:35.839023 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6294043d-cbfe-4794-a76c-01bb6bec8fa8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:35.839507 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6294043d-cbfe-4794-a76c-01bb6bec8fa8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:35.840366 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6294043d-cbfe-4794-a76c-01bb6bec8fa8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:35.840793 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6294043d-cbfe-4794-a76c-01bb6bec8fa8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:35.869579 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7edab996-0ece-49d1-a705-c67496cb46cb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:35.878455 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7edab996-0ece-49d1-a705-c67496cb46cb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1682 microversion: 2.1 time: 0.401298 Jun 16 18:12:35.879023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 326/656] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:35 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1682 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:35.979315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6294043d-cbfe-4794-a76c-01bb6bec8fa8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:35.987329 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6294043d-cbfe-4794-a76c-01bb6bec8fa8 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1666 microversion: 2.1 time: 0.160891 Jun 16 18:12:35.988134 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 331/657] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:35 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:12:36.897289 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-071f2769-e7c7-471d-a087-220ccb6f30d9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:36.898260 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-071f2769-e7c7-471d-a087-220ccb6f30d9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:36.904740 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-071f2769-e7c7-471d-a087-220ccb6f30d9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:36.905184 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-071f2769-e7c7-471d-a087-220ccb6f30d9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:36.905958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-071f2769-e7c7-471d-a087-220ccb6f30d9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:36.906384 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-071f2769-e7c7-471d-a087-220ccb6f30d9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:37.058145 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-071f2769-e7c7-471d-a087-220ccb6f30d9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:37.067307 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-071f2769-e7c7-471d-a087-220ccb6f30d9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1682 microversion: 2.1 time: 0.174101 Jun 16 18:12:37.067921 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 327/658] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:36 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:38.087964 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c231c7e8-d1bd-4ebc-ac3e-cc2d9cdf989b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:38.089167 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c231c7e8-d1bd-4ebc-ac3e-cc2d9cdf989b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:38.097339 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c231c7e8-d1bd-4ebc-ac3e-cc2d9cdf989b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:38.097786 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c231c7e8-d1bd-4ebc-ac3e-cc2d9cdf989b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:38.098564 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c231c7e8-d1bd-4ebc-ac3e-cc2d9cdf989b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:38.098998 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c231c7e8-d1bd-4ebc-ac3e-cc2d9cdf989b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:38.171163 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c231c7e8-d1bd-4ebc-ac3e-cc2d9cdf989b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:38.180483 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c231c7e8-d1bd-4ebc-ac3e-cc2d9cdf989b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1614 microversion: 2.1 time: 0.099143 Jun 16 18:12:38.181059 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 332/659] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:38 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1614 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:38.577294 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-5ac797f9-4eb4-48ce-83fc-eeecbc0645dc req-485ac526-2b2e-48fc-bcb8-7d38e4d0d7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a820253-c5ce-455d-9bf7-ded303efc37c", "name": "network-vif-deleted", "tag": "e95f3b78-5899-46e2-9295-d2c2a36592f2"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:12:38.592241 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-5ac797f9-4eb4-48ce-83fc-eeecbc0645dc req-485ac526-2b2e-48fc-bcb8-7d38e4d0d7e0 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:38.593026 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-5ac797f9-4eb4-48ce-83fc-eeecbc0645dc req-485ac526-2b2e-48fc-bcb8-7d38e4d0d7e0 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:38.614701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-5ac797f9-4eb4-48ce-83fc-eeecbc0645dc req-485ac526-2b2e-48fc-bcb8-7d38e4d0d7e0 service nova] Creating event network-vif-deleted:e95f3b78-5899-46e2-9295-d2c2a36592f2 for instance 3a820253-c5ce-455d-9bf7-ded303efc37c on hv-cinder-83754 Jun 16 18:12:38.623389 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-5ac797f9-4eb4-48ce-83fc-eeecbc0645dc req-485ac526-2b2e-48fc-bcb8-7d38e4d0d7e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155117 Jun 16 18:12:38.624472 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 328/660] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:12:39.201687 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ebaef2ee-adc1-415e-807d-3334d2d6cd6c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:39.203239 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ebaef2ee-adc1-415e-807d-3334d2d6cd6c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:39.217319 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ebaef2ee-adc1-415e-807d-3334d2d6cd6c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:39.218428 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ebaef2ee-adc1-415e-807d-3334d2d6cd6c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:39.220065 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ebaef2ee-adc1-415e-807d-3334d2d6cd6c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:39.222152 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ebaef2ee-adc1-415e-807d-3334d2d6cd6c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:39.275962 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ebaef2ee-adc1-415e-807d-3334d2d6cd6c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:39.276284 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ebaef2ee-adc1-415e-807d-3334d2d6cd6c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:39.277111 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-ebaef2ee-adc1-415e-807d-3334d2d6cd6c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lazy-loading 'fault' on Instance uuid 3a820253-c5ce-455d-9bf7-ded303efc37c {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:12:39.334800 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ebaef2ee-adc1-415e-807d-3334d2d6cd6c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:39.346640 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ebaef2ee-adc1-415e-807d-3334d2d6cd6c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 200 len: 1331 microversion: 2.1 time: 0.150226 Jun 16 18:12:39.361417 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 333/661] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:39 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 1331 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:40.376072 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b870c08f-34ab-4f16-95b2-e1b5a6de1003 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:40.377734 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b870c08f-34ab-4f16-95b2-e1b5a6de1003 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:40.384622 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b870c08f-34ab-4f16-95b2-e1b5a6de1003 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:40.385072 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b870c08f-34ab-4f16-95b2-e1b5a6de1003 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:40.385847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b870c08f-34ab-4f16-95b2-e1b5a6de1003 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:40.386279 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b870c08f-34ab-4f16-95b2-e1b5a6de1003 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:40.401059 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-b870c08f-34ab-4f16-95b2-e1b5a6de1003 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b870c08f-34ab-4f16-95b2-e1b5a6de1003 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c HTTP/1.1 Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:12:40.402711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:12:40.405154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:12:40.405154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:12:40.405154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:12:40.405154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:12:40.405154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:12:40.405154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:12:40.405154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:12:40.405154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:12:40.405154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:12:40.405154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:12:40.405154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:12:40.405154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '3a820253-c5ce-455d-9bf7-ded303efc37c'} Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:12:40.406458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:12:40.409282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:12:40.411601 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b870c08f-34ab-4f16-95b2-e1b5a6de1003 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 404 to user: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:12:40.411601 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b870c08f-34ab-4f16-95b2-e1b5a6de1003 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 404 len: 111 microversion: 2.1 time: 0.033485 Jun 16 18:12:40.411601 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 329/662] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:40 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:12:40.419833 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-fb71b26e-7b7d-4c5f-877b-0d5fae035bab tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '.version_select at 0x7f9c23ca5160>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:40.583569 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-fb71b26e-7b7d-4c5f-877b-0d5fae035bab tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083367325" status: 202 len: 0 microversion: 2.1 time: 0.169339 Jun 16 18:12:40.584579 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 334/663] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jun 16 18:12:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083367325 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:12:41.648466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-fda2c2a4-36b0-46b2-b9c6-e75348e74505 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:41.649292 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-fda2c2a4-36b0-46b2-b9c6-e75348e74505 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:41.655722 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fda2c2a4-36b0-46b2-b9c6-e75348e74505 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:41.656165 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fda2c2a4-36b0-46b2-b9c6-e75348e74505 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:41.656925 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fda2c2a4-36b0-46b2-b9c6-e75348e74505 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:41.657356 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fda2c2a4-36b0-46b2-b9c6-e75348e74505 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:41.816188 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-fda2c2a4-36b0-46b2-b9c6-e75348e74505 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lazy-loading 'services' on Instance uuid 77efc8cd-421f-42e8-98e5-cb9e269e9e6e {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:12:42.060403 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-fda2c2a4-36b0-46b2-b9c6-e75348e74505 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/os-volume_attachments/aea07d3e-d5e1-4df1-8c9a-818559cb5782" status: 202 len: 0 microversion: 2.1 time: 0.415653 Jun 16 18:12:42.061282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 330/664] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jun 16 18:12:41 2022] DELETE /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/os-volume_attachments/aea07d3e-d5e1-4df1-8c9a-818559cb5782 => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:12:42.071323 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ffdf46f2-3adc-4370-bcac-8ab5310c1474 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:42.076212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ffdf46f2-3adc-4370-bcac-8ab5310c1474 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:42.083349 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ffdf46f2-3adc-4370-bcac-8ab5310c1474 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:42.084167 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ffdf46f2-3adc-4370-bcac-8ab5310c1474 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:42.085798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ffdf46f2-3adc-4370-bcac-8ab5310c1474 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:42.086597 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ffdf46f2-3adc-4370-bcac-8ab5310c1474 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:42.133872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ffdf46f2-3adc-4370-bcac-8ab5310c1474 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066931 Jun 16 18:12:42.134452 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 335/665] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:12:42 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:12:43.147175 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e2f114b1-7d5d-401b-814a-7121e8de2dda tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:43.148276 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e2f114b1-7d5d-401b-814a-7121e8de2dda tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:43.154960 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e2f114b1-7d5d-401b-814a-7121e8de2dda tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:43.155527 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e2f114b1-7d5d-401b-814a-7121e8de2dda tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:43.156287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e2f114b1-7d5d-401b-814a-7121e8de2dda tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:43.156728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e2f114b1-7d5d-401b-814a-7121e8de2dda tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:43.188824 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e2f114b1-7d5d-401b-814a-7121e8de2dda tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046532 Jun 16 18:12:43.189442 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 331/666] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:12:43 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:12:44.201699 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-19980193-f3bb-4ead-babc-ca7deefceede tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:44.202615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-19980193-f3bb-4ead-babc-ca7deefceede tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:44.206147 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:12:44.211528 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-19980193-f3bb-4ead-babc-ca7deefceede tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:44.211980 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-19980193-f3bb-4ead-babc-ca7deefceede tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:44.212781 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-19980193-f3bb-4ead-babc-ca7deefceede tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:44.213218 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-19980193-f3bb-4ead-babc-ca7deefceede tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:44.242352 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-19980193-f3bb-4ead-babc-ca7deefceede tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044661 Jun 16 18:12:44.243064 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 336/667] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:12:44 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:12:44.313971 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-86fa1fd0-a69f-4b9c-9228-fe0b31be19b7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:44.315068 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-86fa1fd0-a69f-4b9c-9228-fe0b31be19b7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:44.321582 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-86fa1fd0-a69f-4b9c-9228-fe0b31be19b7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:44.322025 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-86fa1fd0-a69f-4b9c-9228-fe0b31be19b7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:44.322842 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-86fa1fd0-a69f-4b9c-9228-fe0b31be19b7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:44.323273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-86fa1fd0-a69f-4b9c-9228-fe0b31be19b7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:44.352896 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-86fa1fd0-a69f-4b9c-9228-fe0b31be19b7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Going to try to terminate instance {{(pid=118161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:12:44.482024 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:12:44.745814 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-86fa1fd0-a69f-4b9c-9228-fe0b31be19b7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 204 len: 0 microversion: 2.1 time: 0.436613 Jun 16 18:12:44.746507 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 332/668] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:12:44 2022] DELETE /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:12:44.757336 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-cae7b44b-51f3-4a40-b562-812febba8b3d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:44.758015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-cae7b44b-51f3-4a40-b562-812febba8b3d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:44.764222 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cae7b44b-51f3-4a40-b562-812febba8b3d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:44.764665 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cae7b44b-51f3-4a40-b562-812febba8b3d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:44.765426 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cae7b44b-51f3-4a40-b562-812febba8b3d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:44.765861 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cae7b44b-51f3-4a40-b562-812febba8b3d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:44.909076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-cae7b44b-51f3-4a40-b562-812febba8b3d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:44.918461 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-cae7b44b-51f3-4a40-b562-812febba8b3d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1682 microversion: 2.1 time: 0.166850 Jun 16 18:12:44.919037 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 337/669] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:44 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:45.936646 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2cd96c60-0072-4a79-b594-2d37cc7955f2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:45.937344 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2cd96c60-0072-4a79-b594-2d37cc7955f2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:45.944261 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2cd96c60-0072-4a79-b594-2d37cc7955f2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:45.944707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2cd96c60-0072-4a79-b594-2d37cc7955f2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:45.945479 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2cd96c60-0072-4a79-b594-2d37cc7955f2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:45.945914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2cd96c60-0072-4a79-b594-2d37cc7955f2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:46.084998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2cd96c60-0072-4a79-b594-2d37cc7955f2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:46.096750 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2cd96c60-0072-4a79-b594-2d37cc7955f2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1682 microversion: 2.1 time: 0.163596 Jun 16 18:12:46.097540 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 333/670] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:45 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:47.118376 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f21ab2cb-c444-4a95-b455-c5b8a1d33133 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:47.119902 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f21ab2cb-c444-4a95-b455-c5b8a1d33133 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:47.131793 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f21ab2cb-c444-4a95-b455-c5b8a1d33133 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:47.133182 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f21ab2cb-c444-4a95-b455-c5b8a1d33133 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:47.134889 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f21ab2cb-c444-4a95-b455-c5b8a1d33133 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:47.135661 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f21ab2cb-c444-4a95-b455-c5b8a1d33133 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:47.169405 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-0ba4ff3e-eda1-4a9c-8e63-7fd1e180dad5 req-682666da-24cd-4976-90b7-b1eab7ed2522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77efc8cd-421f-42e8-98e5-cb9e269e9e6e", "name": "network-vif-deleted", "tag": "8557bd0c-ae73-4af6-b470-984e296cdd16"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:12:47.175381 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:12:47.179874 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-0ba4ff3e-eda1-4a9c-8e63-7fd1e180dad5 req-682666da-24cd-4976-90b7-b1eab7ed2522 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:47.180325 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-0ba4ff3e-eda1-4a9c-8e63-7fd1e180dad5 req-682666da-24cd-4976-90b7-b1eab7ed2522 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:47.193533 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-0ba4ff3e-eda1-4a9c-8e63-7fd1e180dad5 req-682666da-24cd-4976-90b7-b1eab7ed2522 service nova] Creating event network-vif-deleted:8557bd0c-ae73-4af6-b470-984e296cdd16 for instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e on hv-cinder-83754 Jun 16 18:12:47.198911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-0ba4ff3e-eda1-4a9c-8e63-7fd1e180dad5 req-682666da-24cd-4976-90b7-b1eab7ed2522 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033033 Jun 16 18:12:47.200074 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 334/671] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:12:47.218202 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f21ab2cb-c444-4a95-b455-c5b8a1d33133 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:47.226856 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f21ab2cb-c444-4a95-b455-c5b8a1d33133 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1614 microversion: 2.1 time: 0.114253 Jun 16 18:12:47.230383 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 338/672] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:47 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1614 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:48.247491 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2b2993a4-35db-4e74-adf9-fdd1a035bde5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:48.248294 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2b2993a4-35db-4e74-adf9-fdd1a035bde5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:48.256000 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b2993a4-35db-4e74-adf9-fdd1a035bde5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:48.256462 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b2993a4-35db-4e74-adf9-fdd1a035bde5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:48.257288 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b2993a4-35db-4e74-adf9-fdd1a035bde5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:48.257728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b2993a4-35db-4e74-adf9-fdd1a035bde5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:48.294219 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b2993a4-35db-4e74-adf9-fdd1a035bde5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:48.294682 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b2993a4-35db-4e74-adf9-fdd1a035bde5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:48.295134 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-2b2993a4-35db-4e74-adf9-fdd1a035bde5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lazy-loading 'fault' on Instance uuid 77efc8cd-421f-42e8-98e5-cb9e269e9e6e {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:12:48.339207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2b2993a4-35db-4e74-adf9-fdd1a035bde5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:48.347622 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2b2993a4-35db-4e74-adf9-fdd1a035bde5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 200 len: 1331 microversion: 2.1 time: 0.107023 Jun 16 18:12:48.348218 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 335/673] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:48 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:49.366536 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f9c60a8a-f0f3-44e8-a83a-5bcd1c5a7576 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:49.367151 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f9c60a8a-f0f3-44e8-a83a-5bcd1c5a7576 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:49.373887 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f9c60a8a-f0f3-44e8-a83a-5bcd1c5a7576 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:49.374335 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f9c60a8a-f0f3-44e8-a83a-5bcd1c5a7576 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:49.375132 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f9c60a8a-f0f3-44e8-a83a-5bcd1c5a7576 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:49.375592 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f9c60a8a-f0f3-44e8-a83a-5bcd1c5a7576 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:49.379108 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:12:49.393836 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-f9c60a8a-f0f3-44e8-a83a-5bcd1c5a7576 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f9c60a8a-f0f3-44e8-a83a-5bcd1c5a7576 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e HTTP/1.1 Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:12:49.396430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:12:49.398831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:12:49.398831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:12:49.398831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:12:49.398831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:12:49.398831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:12:49.398831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:12:49.398831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:12:49.398831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:12:49.398831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:12:49.398831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:12:49.398831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:12:49.398831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '77efc8cd-421f-42e8-98e5-cb9e269e9e6e'} Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:12:49.399852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:12:49.402283 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:12:49.404281 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f9c60a8a-f0f3-44e8-a83a-5bcd1c5a7576 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 404 to user: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:12:49.404281 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f9c60a8a-f0f3-44e8-a83a-5bcd1c5a7576 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 404 len: 111 microversion: 2.1 time: 0.035436 Jun 16 18:12:49.404281 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 339/674] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:49 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:12:49.406242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-49dd5142-a0dd-4662-bc6a-753e24fc9871 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '.version_select at 0x7f9c3048b1f0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:49.409882 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR oslo.messaging._drivers.impl_rabbit [None req-49dd5142-a0dd-4662-bc6a-753e24fc9871 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [143b13db-ce80-458a-a58a-7639958fa996] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 18:12:50.417422 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO oslo.messaging._drivers.impl_rabbit [None req-49dd5142-a0dd-4662-bc6a-753e24fc9871 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [143b13db-ce80-458a-a58a-7639958fa996] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47540. Jun 16 18:12:50.497203 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-49dd5142-a0dd-4662-bc6a-753e24fc9871 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698248313" status: 202 len: 0 microversion: 2.1 time: 1.094666 Jun 16 18:12:50.498112 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 336/675] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jun 16 18:12:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1698248313 => generated 0 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:12:51.442886 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2e614a00-d7cd-438d-af0d-cbc57375cc34 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: .version_select at 0x7f9c23b92700>, body: {"keypair": {"name": "tempest-keypair-1979057260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuz+72TNzx9t2tjzCOCHE5ViPfHLRobQl+Vk4f7Xqdbh4i9ucW5F5dNMTJnV/rJVYsa8ww8T0nu/LggcZdtykn4dUp/NOZ0pLQ8esjEeaK/PCni38jbM3/KC7LFwWj6kQ=="}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:12:51.459534 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-2e614a00-d7cd-438d-af0d-cbc57375cc34 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'key_pairs'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:12:51.465158 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-2e614a00-d7cd-438d-af0d-cbc57375cc34 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for user 8498989e673d445dbc70aa9df55f391b and project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'key_pairs'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:12:51.547823 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2e614a00-d7cd-438d-af0d-cbc57375cc34 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109036 Jun 16 18:12:51.548342 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 340/676] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jun 16 18:12:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:12:53.929282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-951084763", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f17e2725-a961-43b0-9ec4-3a8964c308ae"}], "security_groups": [{"name": "tempest-securitygroup--638055377"}], "key_name": "tempest-keypair-1979057260", "user_data": "}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:12:54.037407 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] validate_networks() for [('f17e2725-a961-43b0-9ec4-3a8964c308ae', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:12:54.486434 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:12:54.486854 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:12:54.487491 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:12:54.487998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:12:54.488470 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:12:54.498042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:54.498490 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:54.499284 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:54.499752 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:54.516778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:12:54.521540 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for user 8498989e673d445dbc70aa9df55f391b and project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:12:54.532594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:12:54.535536 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:12:54.691468 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-72789af4-2f9d-4b18-8381-325121696fd7 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.766055 Jun 16 18:12:54.692066 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 337/677] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:12:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:12:54.710302 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8e290d59-3a68-484f-ad6c-42ddc170fa56 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:54.710302 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8e290d59-3a68-484f-ad6c-42ddc170fa56 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:54.778726 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8e290d59-3a68-484f-ad6c-42ddc170fa56 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:54.788507 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8e290d59-3a68-484f-ad6c-42ddc170fa56 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1241 microversion: 2.1 time: 0.089877 Jun 16 18:12:54.795872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 341/678] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:54 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:55.806766 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d7ca9d83-8d96-4e55-afaa-f0e6f4c190ae tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:55.807431 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d7ca9d83-8d96-4e55-afaa-f0e6f4c190ae tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:55.814439 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d7ca9d83-8d96-4e55-afaa-f0e6f4c190ae tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:55.814885 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d7ca9d83-8d96-4e55-afaa-f0e6f4c190ae tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:55.816634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d7ca9d83-8d96-4e55-afaa-f0e6f4c190ae tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:55.816992 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d7ca9d83-8d96-4e55-afaa-f0e6f4c190ae tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:55.887761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d7ca9d83-8d96-4e55-afaa-f0e6f4c190ae tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:55.897264 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d7ca9d83-8d96-4e55-afaa-f0e6f4c190ae tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1245 microversion: 2.1 time: 0.094832 Jun 16 18:12:55.898171 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 338/679] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:55 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:56.917060 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-55461328-6f36-40cc-8440-971ef489f4eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:56.917776 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-55461328-6f36-40cc-8440-971ef489f4eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:56.925204 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-55461328-6f36-40cc-8440-971ef489f4eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:56.925657 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-55461328-6f36-40cc-8440-971ef489f4eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:56.927264 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-55461328-6f36-40cc-8440-971ef489f4eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:56.927264 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-55461328-6f36-40cc-8440-971ef489f4eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:57.000656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-55461328-6f36-40cc-8440-971ef489f4eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:57.008925 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-55461328-6f36-40cc-8440-971ef489f4eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1293 microversion: 2.1 time: 0.095672 Jun 16 18:12:57.009505 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 342/680] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:56 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:58.026651 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2b8d5a68-c422-488e-94cd-7e09b6b43a6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:58.027260 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2b8d5a68-c422-488e-94cd-7e09b6b43a6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:58.035536 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b8d5a68-c422-488e-94cd-7e09b6b43a6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:58.039795 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b8d5a68-c422-488e-94cd-7e09b6b43a6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:58.039795 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b8d5a68-c422-488e-94cd-7e09b6b43a6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:58.039795 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2b8d5a68-c422-488e-94cd-7e09b6b43a6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:58.208350 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2b8d5a68-c422-488e-94cd-7e09b6b43a6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:58.216263 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2b8d5a68-c422-488e-94cd-7e09b6b43a6b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1366 microversion: 2.1 time: 0.193540 Jun 16 18:12:58.217057 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 339/681] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:58 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:12:58.938197 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-98968546-2bcc-45c5-b060-d382eee71864 req-4a40afc9-e4e8-4196-a77c-1cd56d3d2c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5661854e-8257-40d2-a5a1-44224818fe5c", "tag": "8072838b-95b3-4cd1-b019-78c95263a184"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:12:58.948951 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-98968546-2bcc-45c5-b060-d382eee71864 req-4a40afc9-e4e8-4196-a77c-1cd56d3d2c79 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:58.949864 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-98968546-2bcc-45c5-b060-d382eee71864 req-4a40afc9-e4e8-4196-a77c-1cd56d3d2c79 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:58.963340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-98968546-2bcc-45c5-b060-d382eee71864 req-4a40afc9-e4e8-4196-a77c-1cd56d3d2c79 service nova] Creating event network-changed:8072838b-95b3-4cd1-b019-78c95263a184 for instance 5661854e-8257-40d2-a5a1-44224818fe5c on hv-cinder-83754 Jun 16 18:12:58.969568 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-98968546-2bcc-45c5-b060-d382eee71864 req-4a40afc9-e4e8-4196-a77c-1cd56d3d2c79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035415 Jun 16 18:12:58.970164 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 343/682] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:12:59.236493 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c9419163-0633-4b50-bd4f-9ca92f149710 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:59.237833 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c9419163-0633-4b50-bd4f-9ca92f149710 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:59.248465 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c9419163-0633-4b50-bd4f-9ca92f149710 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:59.248723 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c9419163-0633-4b50-bd4f-9ca92f149710 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:59.249702 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c9419163-0633-4b50-bd4f-9ca92f149710 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:59.249892 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c9419163-0633-4b50-bd4f-9ca92f149710 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:59.393161 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c9419163-0633-4b50-bd4f-9ca92f149710 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:12:59.403593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c9419163-0633-4b50-bd4f-9ca92f149710 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1366 microversion: 2.1 time: 0.171037 Jun 16 18:12:59.404182 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 340/683] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:12:59 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:12:59.886908 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3c5b092b-4d85-4527-b7d5-31e8eea07ec0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:12:59.887547 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3c5b092b-4d85-4527-b7d5-31e8eea07ec0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:12:59.894919 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3c5b092b-4d85-4527-b7d5-31e8eea07ec0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:59.895398 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3c5b092b-4d85-4527-b7d5-31e8eea07ec0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:59.896175 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3c5b092b-4d85-4527-b7d5-31e8eea07ec0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:12:59.896608 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3c5b092b-4d85-4527-b7d5-31e8eea07ec0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:12:59.932884 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3c5b092b-4d85-4527-b7d5-31e8eea07ec0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments/9e76996f-e9d2-4d13-97dd-c9e2fada9d14" status: 200 len: 194 microversion: 2.20 time: 0.050323 Jun 16 18:12:59.933685 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 344/684] 10.222.0.58 () {60 vars in 1453 bytes} [Thu Jun 16 18:12:59 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments/9e76996f-e9d2-4d13-97dd-c9e2fada9d14 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:13:00.006358 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0177f780-7d89-44e4-92f0-1d6732d0a3a8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:00.007047 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0177f780-7d89-44e4-92f0-1d6732d0a3a8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:00.013826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0177f780-7d89-44e4-92f0-1d6732d0a3a8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:00.018055 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0177f780-7d89-44e4-92f0-1d6732d0a3a8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:00.018055 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0177f780-7d89-44e4-92f0-1d6732d0a3a8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:00.018055 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0177f780-7d89-44e4-92f0-1d6732d0a3a8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:00.122789 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-0177f780-7d89-44e4-92f0-1d6732d0a3a8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lazy-loading 'services' on Instance uuid 279175ca-aad1-40da-a191-4712cbd17771 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:13:00.370427 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0177f780-7d89-44e4-92f0-1d6732d0a3a8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "DELETE /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments/9e76996f-e9d2-4d13-97dd-c9e2fada9d14" status: 202 len: 0 microversion: 2.20 time: 0.371124 Jun 16 18:13:00.371212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 341/685] 10.222.0.58 () {60 vars in 1456 bytes} [Thu Jun 16 18:12:59 2022] DELETE /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments/9e76996f-e9d2-4d13-97dd-c9e2fada9d14 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:13:00.381852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-85fbaaec-a44f-4320-a6f7-3b9549c7ab1c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:00.382843 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-85fbaaec-a44f-4320-a6f7-3b9549c7ab1c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:00.392825 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-85fbaaec-a44f-4320-a6f7-3b9549c7ab1c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:00.393274 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-85fbaaec-a44f-4320-a6f7-3b9549c7ab1c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:00.394042 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-85fbaaec-a44f-4320-a6f7-3b9549c7ab1c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:00.394618 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-85fbaaec-a44f-4320-a6f7-3b9549c7ab1c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:00.423859 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-09a77599-3687-4249-8589-821980015b6f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:00.424908 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-09a77599-3687-4249-8589-821980015b6f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:00.426063 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-85fbaaec-a44f-4320-a6f7-3b9549c7ab1c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048717 Jun 16 18:13:00.427253 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 345/686] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jun 16 18:13:00 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:13:00.436695 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-09a77599-3687-4249-8589-821980015b6f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:00.437146 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-09a77599-3687-4249-8589-821980015b6f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:00.437916 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-09a77599-3687-4249-8589-821980015b6f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:00.438348 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-09a77599-3687-4249-8589-821980015b6f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:00.578113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-09a77599-3687-4249-8589-821980015b6f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:00.586182 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-09a77599-3687-4249-8589-821980015b6f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1366 microversion: 2.1 time: 0.167282 Jun 16 18:13:00.586758 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 342/687] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:00 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:01.438687 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c4bdf75a-d633-4a94-a585-e89ec833a8c0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:01.439622 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c4bdf75a-d633-4a94-a585-e89ec833a8c0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:01.446858 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c4bdf75a-d633-4a94-a585-e89ec833a8c0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:01.447297 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c4bdf75a-d633-4a94-a585-e89ec833a8c0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:01.448097 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c4bdf75a-d633-4a94-a585-e89ec833a8c0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:01.448525 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c4bdf75a-d633-4a94-a585-e89ec833a8c0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:01.481564 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c4bdf75a-d633-4a94-a585-e89ec833a8c0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047088 Jun 16 18:13:01.482162 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 346/688] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jun 16 18:13:01 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:13:01.610465 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-69b46e89-58fa-451a-b84c-261278c1fba9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:01.611330 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-69b46e89-58fa-451a-b84c-261278c1fba9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:01.618387 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-69b46e89-58fa-451a-b84c-261278c1fba9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:01.618843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-69b46e89-58fa-451a-b84c-261278c1fba9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:01.619651 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-69b46e89-58fa-451a-b84c-261278c1fba9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:01.620086 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-69b46e89-58fa-451a-b84c-261278c1fba9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:01.767968 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-69b46e89-58fa-451a-b84c-261278c1fba9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:01.776013 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-69b46e89-58fa-451a-b84c-261278c1fba9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1366 microversion: 2.1 time: 0.169838 Jun 16 18:13:01.776602 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 343/689] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:01 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:02.494983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b35c6477-3a08-4f44-86e9-74cc33d47625 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:02.496418 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b35c6477-3a08-4f44-86e9-74cc33d47625 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:02.509051 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b35c6477-3a08-4f44-86e9-74cc33d47625 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:02.509051 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b35c6477-3a08-4f44-86e9-74cc33d47625 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:02.509051 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b35c6477-3a08-4f44-86e9-74cc33d47625 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:02.509051 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b35c6477-3a08-4f44-86e9-74cc33d47625 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:02.539811 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b35c6477-3a08-4f44-86e9-74cc33d47625 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049320 Jun 16 18:13:02.540422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 347/690] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jun 16 18:13:02 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:13:02.799844 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-91af4203-3505-4405-9e0f-4dad592079d4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:02.801611 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-91af4203-3505-4405-9e0f-4dad592079d4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:02.811298 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-91af4203-3505-4405-9e0f-4dad592079d4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:02.811775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-91af4203-3505-4405-9e0f-4dad592079d4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:02.812553 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-91af4203-3505-4405-9e0f-4dad592079d4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:02.812983 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-91af4203-3505-4405-9e0f-4dad592079d4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:02.980746 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-91af4203-3505-4405-9e0f-4dad592079d4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:02.997510 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-91af4203-3505-4405-9e0f-4dad592079d4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1366 microversion: 2.1 time: 0.203781 Jun 16 18:13:02.998104 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 344/691] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:02 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:03.553231 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3c2f2f19-4df1-4552-b170-5d632b1a0bc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:03.554054 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3c2f2f19-4df1-4552-b170-5d632b1a0bc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:03.560846 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3c2f2f19-4df1-4552-b170-5d632b1a0bc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:03.561289 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3c2f2f19-4df1-4552-b170-5d632b1a0bc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:03.562051 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3c2f2f19-4df1-4552-b170-5d632b1a0bc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:03.562478 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3c2f2f19-4df1-4552-b170-5d632b1a0bc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:03.608772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3c2f2f19-4df1-4552-b170-5d632b1a0bc8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050454 Jun 16 18:13:03.608772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 348/692] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jun 16 18:13:03 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:13:04.019888 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7411ee8f-f9f5-413f-b006-e8eacbb5d345 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:04.021005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7411ee8f-f9f5-413f-b006-e8eacbb5d345 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:04.033454 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7411ee8f-f9f5-413f-b006-e8eacbb5d345 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:04.042079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7411ee8f-f9f5-413f-b006-e8eacbb5d345 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:04.042079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7411ee8f-f9f5-413f-b006-e8eacbb5d345 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:04.042079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7411ee8f-f9f5-413f-b006-e8eacbb5d345 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:04.213609 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7411ee8f-f9f5-413f-b006-e8eacbb5d345 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:04.221772 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7411ee8f-f9f5-413f-b006-e8eacbb5d345 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1366 microversion: 2.1 time: 0.209405 Jun 16 18:13:04.222488 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 345/693] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:04 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:04.610707 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5af116f5-9243-42ce-8ca1-92cf0c71e3b0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:04.611661 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5af116f5-9243-42ce-8ca1-92cf0c71e3b0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:04.618801 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5af116f5-9243-42ce-8ca1-92cf0c71e3b0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:04.619246 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5af116f5-9243-42ce-8ca1-92cf0c71e3b0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:04.620045 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5af116f5-9243-42ce-8ca1-92cf0c71e3b0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:04.620472 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5af116f5-9243-42ce-8ca1-92cf0c71e3b0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:04.652482 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5af116f5-9243-42ce-8ca1-92cf0c71e3b0 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045914 Jun 16 18:13:04.653046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 349/694] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jun 16 18:13:04 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:04.717998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0d61f269-1c07-4541-a0d0-ba0939bbae57 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:04.718487 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0d61f269-1c07-4541-a0d0-ba0939bbae57 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:04.720466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:04.721178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=6 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:04.726855 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0d61f269-1c07-4541-a0d0-ba0939bbae57 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:04.727295 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0d61f269-1c07-4541-a0d0-ba0939bbae57 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:04.728101 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0d61f269-1c07-4541-a0d0-ba0939bbae57 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:04.728557 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0d61f269-1c07-4541-a0d0-ba0939bbae57 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:04.760455 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0d61f269-1c07-4541-a0d0-ba0939bbae57 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Going to try to terminate instance {{(pid=118161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:13:05.158536 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0d61f269-1c07-4541-a0d0-ba0939bbae57 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "DELETE /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 204 len: 0 microversion: 2.20 time: 0.444187 Jun 16 18:13:05.160863 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 346/695] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Jun 16 18:13:04 2022] DELETE /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:13:05.168721 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f30799d8-577b-4a22-b860-0339d421e9ae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:05.169974 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f30799d8-577b-4a22-b860-0339d421e9ae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:05.173526 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=6 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:05.179211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f30799d8-577b-4a22-b860-0339d421e9ae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:05.179722 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f30799d8-577b-4a22-b860-0339d421e9ae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:05.180538 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f30799d8-577b-4a22-b860-0339d421e9ae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:05.180957 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f30799d8-577b-4a22-b860-0339d421e9ae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:05.247408 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f0e4cd53-f133-4a07-8b10-0c16b66ea4a5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:05.247408 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f0e4cd53-f133-4a07-8b10-0c16b66ea4a5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:05.256111 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f0e4cd53-f133-4a07-8b10-0c16b66ea4a5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:05.257731 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f0e4cd53-f133-4a07-8b10-0c16b66ea4a5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:05.258580 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f0e4cd53-f133-4a07-8b10-0c16b66ea4a5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:05.259700 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f0e4cd53-f133-4a07-8b10-0c16b66ea4a5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:05.425409 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f30799d8-577b-4a22-b860-0339d421e9ae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:05.434467 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f30799d8-577b-4a22-b860-0339d421e9ae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:05.437741 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f30799d8-577b-4a22-b860-0339d421e9ae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:05.439017 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f30799d8-577b-4a22-b860-0339d421e9ae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.274339 Jun 16 18:13:05.439621 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 350/696] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:05 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:05.521506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f0e4cd53-f133-4a07-8b10-0c16b66ea4a5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:05.529672 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f0e4cd53-f133-4a07-8b10-0c16b66ea4a5 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1366 microversion: 2.1 time: 0.289384 Jun 16 18:13:05.530596 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 347/697] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:05 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:05.709376 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-24525e39-6d29-4404-b888-14f123390e88 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:05.709992 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-24525e39-6d29-4404-b888-14f123390e88 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:05.717051 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24525e39-6d29-4404-b888-14f123390e88 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:05.717502 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24525e39-6d29-4404-b888-14f123390e88 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:05.718278 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24525e39-6d29-4404-b888-14f123390e88 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:05.718711 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24525e39-6d29-4404-b888-14f123390e88 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:05.807196 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-24525e39-6d29-4404-b888-14f123390e88 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lazy-loading 'services' on Instance uuid 1b2de096-32e0-4f4e-835d-4e3ba69263c9 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:13:06.115139 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-24525e39-6d29-4404-b888-14f123390e88 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments/940d64c2-2d78-4026-99c2-03ce75dfa643" status: 202 len: 0 microversion: 2.1 time: 0.410222 Jun 16 18:13:06.115768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 351/698] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jun 16 18:13:05 2022] DELETE /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments/940d64c2-2d78-4026-99c2-03ce75dfa643 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:13:06.124383 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e878faeb-b4a5-49d5-801e-2ef16b442ab8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:06.129173 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e878faeb-b4a5-49d5-801e-2ef16b442ab8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:06.133278 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e878faeb-b4a5-49d5-801e-2ef16b442ab8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:06.133725 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e878faeb-b4a5-49d5-801e-2ef16b442ab8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:06.134486 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e878faeb-b4a5-49d5-801e-2ef16b442ab8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:06.134921 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e878faeb-b4a5-49d5-801e-2ef16b442ab8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:06.168206 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e878faeb-b4a5-49d5-801e-2ef16b442ab8 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047739 Jun 16 18:13:06.168945 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 348/699] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:13:06 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:06.465353 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-bab320a4-472c-451c-bc0f-e127c4bfe6a9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:06.466100 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-bab320a4-472c-451c-bc0f-e127c4bfe6a9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:06.473635 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bab320a4-472c-451c-bc0f-e127c4bfe6a9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:06.474079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bab320a4-472c-451c-bc0f-e127c4bfe6a9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:06.474858 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bab320a4-472c-451c-bc0f-e127c4bfe6a9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:06.475292 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bab320a4-472c-451c-bc0f-e127c4bfe6a9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:06.553005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-01f7e7c3-0816-4858-933f-ab04b189714d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:06.553624 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-01f7e7c3-0816-4858-933f-ab04b189714d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:06.560303 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-01f7e7c3-0816-4858-933f-ab04b189714d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:06.560753 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-01f7e7c3-0816-4858-933f-ab04b189714d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:06.561522 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-01f7e7c3-0816-4858-933f-ab04b189714d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:06.562152 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-01f7e7c3-0816-4858-933f-ab04b189714d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:06.566536 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:06.682113 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-bab320a4-472c-451c-bc0f-e127c4bfe6a9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:06.691706 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-bab320a4-472c-451c-bc0f-e127c4bfe6a9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:06.694054 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-bab320a4-472c-451c-bc0f-e127c4bfe6a9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:06.695632 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-bab320a4-472c-451c-bc0f-e127c4bfe6a9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.234380 Jun 16 18:13:06.696219 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 352/700] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:06 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:06.736149 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-01f7e7c3-0816-4858-933f-ab04b189714d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:06.746435 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-01f7e7c3-0816-4858-933f-ab04b189714d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1366 microversion: 2.1 time: 0.198471 Jun 16 18:13:06.747181 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 349/701] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:06 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:06.941047 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-abb698ae-3665-4001-8fad-cdc7283d4641 req-bb5cc33b-0bc9-4a3d-b685-630cf087f99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5661854e-8257-40d2-a5a1-44224818fe5c", "name": "network-vif-plugged", "status": "completed", "tag": "8072838b-95b3-4cd1-b019-78c95263a184"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:06.949938 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-abb698ae-3665-4001-8fad-cdc7283d4641 req-bb5cc33b-0bc9-4a3d-b685-630cf087f99a service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:06.950380 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-abb698ae-3665-4001-8fad-cdc7283d4641 req-bb5cc33b-0bc9-4a3d-b685-630cf087f99a service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:06.962604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-abb698ae-3665-4001-8fad-cdc7283d4641 req-bb5cc33b-0bc9-4a3d-b685-630cf087f99a service nova] Creating event network-vif-plugged:8072838b-95b3-4cd1-b019-78c95263a184 for instance 5661854e-8257-40d2-a5a1-44224818fe5c on hv-cinder-83754 Jun 16 18:13:06.967475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-abb698ae-3665-4001-8fad-cdc7283d4641 req-bb5cc33b-0bc9-4a3d-b685-630cf087f99a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100672 Jun 16 18:13:06.968070 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 353/702] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:07.180746 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e80d9017-3fe1-4322-aea0-9a93cc08dbf3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:07.181671 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e80d9017-3fe1-4322-aea0-9a93cc08dbf3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:07.189057 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e80d9017-3fe1-4322-aea0-9a93cc08dbf3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:07.189504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e80d9017-3fe1-4322-aea0-9a93cc08dbf3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:07.190268 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e80d9017-3fe1-4322-aea0-9a93cc08dbf3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:07.191214 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e80d9017-3fe1-4322-aea0-9a93cc08dbf3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:07.220412 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e80d9017-3fe1-4322-aea0-9a93cc08dbf3 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043595 Jun 16 18:13:07.220975 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 350/703] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:13:07 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:13:07.716630 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-35a286ab-dd11-4256-b3e9-4c1cd4f1fd75 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:07.717335 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-35a286ab-dd11-4256-b3e9-4c1cd4f1fd75 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:07.724328 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-35a286ab-dd11-4256-b3e9-4c1cd4f1fd75 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:07.724784 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-35a286ab-dd11-4256-b3e9-4c1cd4f1fd75 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:07.725656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-35a286ab-dd11-4256-b3e9-4c1cd4f1fd75 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:07.726102 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-35a286ab-dd11-4256-b3e9-4c1cd4f1fd75 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:07.763965 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-28d90512-4701-4985-824e-f7aa59322252 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:07.764768 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-28d90512-4701-4985-824e-f7aa59322252 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:07.773198 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-28d90512-4701-4985-824e-f7aa59322252 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:07.773951 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-28d90512-4701-4985-824e-f7aa59322252 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:07.774886 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-28d90512-4701-4985-824e-f7aa59322252 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:07.776241 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-28d90512-4701-4985-824e-f7aa59322252 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:07.968100 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-35a286ab-dd11-4256-b3e9-4c1cd4f1fd75 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:07.981096 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-35a286ab-dd11-4256-b3e9-4c1cd4f1fd75 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:07.983118 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-35a286ab-dd11-4256-b3e9-4c1cd4f1fd75 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:07.985271 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-35a286ab-dd11-4256-b3e9-4c1cd4f1fd75 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1723 microversion: 2.20 time: 0.273352 Jun 16 18:13:07.986051 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 354/704] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:07 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:07.998445 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-28d90512-4701-4985-824e-f7aa59322252 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:08.010664 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-28d90512-4701-4985-824e-f7aa59322252 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1366 microversion: 2.1 time: 0.250842 Jun 16 18:13:08.011789 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 351/705] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:07 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:08.233802 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a189b7f7-2532-4b7d-a63b-0cad9b098ded tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:08.234223 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a189b7f7-2532-4b7d-a63b-0cad9b098ded tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:08.241746 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a189b7f7-2532-4b7d-a63b-0cad9b098ded tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:08.242272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a189b7f7-2532-4b7d-a63b-0cad9b098ded tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:08.243270 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a189b7f7-2532-4b7d-a63b-0cad9b098ded tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:08.243746 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a189b7f7-2532-4b7d-a63b-0cad9b098ded tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:08.285693 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a189b7f7-2532-4b7d-a63b-0cad9b098ded tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056745 Jun 16 18:13:08.286277 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 355/706] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:13:08 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:13:08.750572 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-9ff06fba-40c7-4ac4-8843-ed7383721b57 req-f7f44162-248f-40c1-8f1d-107521de9e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "279175ca-aad1-40da-a191-4712cbd17771", "name": "network-vif-deleted", "tag": "d3e274fe-5d79-4687-9f75-5a8fd858ef61"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:08.759747 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-9ff06fba-40c7-4ac4-8843-ed7383721b57 req-f7f44162-248f-40c1-8f1d-107521de9e05 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:08.760446 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-9ff06fba-40c7-4ac4-8843-ed7383721b57 req-f7f44162-248f-40c1-8f1d-107521de9e05 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:08.777902 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-9ff06fba-40c7-4ac4-8843-ed7383721b57 req-f7f44162-248f-40c1-8f1d-107521de9e05 service nova] Creating event network-vif-deleted:d3e274fe-5d79-4687-9f75-5a8fd858ef61 for instance 279175ca-aad1-40da-a191-4712cbd17771 on hv-cinder-83754 Jun 16 18:13:08.782877 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-9ff06fba-40c7-4ac4-8843-ed7383721b57 req-f7f44162-248f-40c1-8f1d-107521de9e05 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036283 Jun 16 18:13:08.783491 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 352/707] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:09.006313 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-af4f296e-cab0-4d9d-bf12-e1d51d914754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:09.006929 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-af4f296e-cab0-4d9d-bf12-e1d51d914754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:09.014220 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-af4f296e-cab0-4d9d-bf12-e1d51d914754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:09.014668 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-af4f296e-cab0-4d9d-bf12-e1d51d914754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:09.015494 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-af4f296e-cab0-4d9d-bf12-e1d51d914754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:09.016266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-af4f296e-cab0-4d9d-bf12-e1d51d914754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:09.048928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ce2b52af-e640-49b2-8840-dc7373581a9b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:09.048928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ce2b52af-e640-49b2-8840-dc7373581a9b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:09.048928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce2b52af-e640-49b2-8840-dc7373581a9b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:09.048928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce2b52af-e640-49b2-8840-dc7373581a9b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:09.049374 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce2b52af-e640-49b2-8840-dc7373581a9b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:09.049827 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce2b52af-e640-49b2-8840-dc7373581a9b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:09.133709 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-af4f296e-cab0-4d9d-bf12-e1d51d914754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:09.145653 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-af4f296e-cab0-4d9d-bf12-e1d51d914754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:09.147256 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-af4f296e-cab0-4d9d-bf12-e1d51d914754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:09.148496 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-af4f296e-cab0-4d9d-bf12-e1d51d914754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1655 microversion: 2.20 time: 0.147261 Jun 16 18:13:09.155891 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 356/708] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:09 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:09.275639 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ce2b52af-e640-49b2-8840-dc7373581a9b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:09.284831 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ce2b52af-e640-49b2-8840-dc7373581a9b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1366 microversion: 2.1 time: 0.251919 Jun 16 18:13:09.285464 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 353/709] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:09 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:09.301078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-bfe3925b-4c50-4b09-8aaf-6f31f30a2f2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:09.302167 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-bfe3925b-4c50-4b09-8aaf-6f31f30a2f2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:09.309013 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bfe3925b-4c50-4b09-8aaf-6f31f30a2f2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:09.309465 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bfe3925b-4c50-4b09-8aaf-6f31f30a2f2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:09.310516 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bfe3925b-4c50-4b09-8aaf-6f31f30a2f2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:09.310955 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bfe3925b-4c50-4b09-8aaf-6f31f30a2f2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:09.353620 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-bfe3925b-4c50-4b09-8aaf-6f31f30a2f2d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056513 Jun 16 18:13:09.354451 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 357/710] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:13:09 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:13:09.456954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-808ec390-93ff-4b55-a6ed-ebbe8c460b18 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:09.457635 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-808ec390-93ff-4b55-a6ed-ebbe8c460b18 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:09.464301 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-808ec390-93ff-4b55-a6ed-ebbe8c460b18 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:09.464843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-808ec390-93ff-4b55-a6ed-ebbe8c460b18 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:09.465710 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-808ec390-93ff-4b55-a6ed-ebbe8c460b18 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:09.466181 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-808ec390-93ff-4b55-a6ed-ebbe8c460b18 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:09.502338 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-808ec390-93ff-4b55-a6ed-ebbe8c460b18 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Going to try to terminate instance {{(pid=118161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:13:10.119347 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-808ec390-93ff-4b55-a6ed-ebbe8c460b18 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 204 len: 0 microversion: 2.1 time: 0.668782 Jun 16 18:13:10.124655 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 354/711] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:13:09 2022] DELETE /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:13:10.133897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ab06fdf4-6170-4b87-9f58-9076040b75b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:10.135074 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ab06fdf4-6170-4b87-9f58-9076040b75b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:10.144483 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab06fdf4-6170-4b87-9f58-9076040b75b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:10.145287 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab06fdf4-6170-4b87-9f58-9076040b75b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:10.146536 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab06fdf4-6170-4b87-9f58-9076040b75b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:10.146990 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab06fdf4-6170-4b87-9f58-9076040b75b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:10.171339 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:10.172061 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:10.179142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:10.179701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:10.180478 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:10.180909 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:10.223739 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:10.224292 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:10.224865 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lazy-loading 'fault' on Instance uuid 279175ca-aad1-40da-a191-4712cbd17771 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:13:10.284895 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:10.296163 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:10.299256 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:10.301498 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-dfbfdc2e-4669-430e-b3b1-2676e873765d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1370 microversion: 2.20 time: 0.135334 Jun 16 18:13:10.313384 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 355/712] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:10 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1370 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:13:10.313384 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1c16d447-0231-4d1d-b44b-9b7012ed3eaa tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:10.313384 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1c16d447-0231-4d1d-b44b-9b7012ed3eaa tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:10.343194 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c16d447-0231-4d1d-b44b-9b7012ed3eaa tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:10.343701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c16d447-0231-4d1d-b44b-9b7012ed3eaa tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:10.345120 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c16d447-0231-4d1d-b44b-9b7012ed3eaa tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:10.345761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c16d447-0231-4d1d-b44b-9b7012ed3eaa tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:10.367657 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ab06fdf4-6170-4b87-9f58-9076040b75b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:10.379522 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ab06fdf4-6170-4b87-9f58-9076040b75b2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1689 microversion: 2.1 time: 0.253853 Jun 16 18:13:10.380116 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 358/713] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:10 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1689 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:10.510799 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1c16d447-0231-4d1d-b44b-9b7012ed3eaa tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:10.527490 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1c16d447-0231-4d1d-b44b-9b7012ed3eaa tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1557 microversion: 2.1 time: 0.223112 Jun 16 18:13:10.528485 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 356/714] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:10 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1557 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:10.553319 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-34d995db-53d5-4389-b9e6-e96405b17677 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:10.553812 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-34d995db-53d5-4389-b9e6-e96405b17677 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:10.560415 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-34d995db-53d5-4389-b9e6-e96405b17677 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:10.560933 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-34d995db-53d5-4389-b9e6-e96405b17677 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:10.562876 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-34d995db-53d5-4389-b9e6-e96405b17677 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:10.563713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-34d995db-53d5-4389-b9e6-e96405b17677 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:10.568700 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:10.659405 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-34d995db-53d5-4389-b9e6-e96405b17677 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110560 Jun 16 18:13:10.660682 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 359/715] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jun 16 18:13:10 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:11.322332 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:11.323212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:11.332060 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:11.332512 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:11.333295 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:11.333730 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:11.368127 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:11.368566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:11.369025 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lazy-loading 'fault' on Instance uuid 279175ca-aad1-40da-a191-4712cbd17771 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:13:11.398572 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-788d8ccb-6b0a-47d8-a1e3-e63b7bac1fb5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:11.399579 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-788d8ccb-6b0a-47d8-a1e3-e63b7bac1fb5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:11.407868 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-788d8ccb-6b0a-47d8-a1e3-e63b7bac1fb5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:11.408343 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-788d8ccb-6b0a-47d8-a1e3-e63b7bac1fb5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:11.409131 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-788d8ccb-6b0a-47d8-a1e3-e63b7bac1fb5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:11.410203 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-788d8ccb-6b0a-47d8-a1e3-e63b7bac1fb5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:11.442242 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:11.451611 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:11.453176 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:11.454361 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7662cb0d-c14e-499c-8d38-8d06d2efe907 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1370 microversion: 2.20 time: 0.136414 Jun 16 18:13:11.454931 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 357/716] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:11 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1370 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:11.639506 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-788d8ccb-6b0a-47d8-a1e3-e63b7bac1fb5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:11.647897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-788d8ccb-6b0a-47d8-a1e3-e63b7bac1fb5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1689 microversion: 2.1 time: 0.254306 Jun 16 18:13:11.648478 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 360/717] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:11 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1689 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:11.922824 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-08c7b97a-eca2-4154-b679-64578e1cc264 req-eede6557-e8f4-455c-a48f-15f0d2ed249f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5661854e-8257-40d2-a5a1-44224818fe5c", "tag": "8072838b-95b3-4cd1-b019-78c95263a184"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:11.932348 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-08c7b97a-eca2-4154-b679-64578e1cc264 req-eede6557-e8f4-455c-a48f-15f0d2ed249f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:11.939870 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-08c7b97a-eca2-4154-b679-64578e1cc264 req-eede6557-e8f4-455c-a48f-15f0d2ed249f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:11.949346 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-08c7b97a-eca2-4154-b679-64578e1cc264 req-eede6557-e8f4-455c-a48f-15f0d2ed249f service nova] Creating event network-changed:8072838b-95b3-4cd1-b019-78c95263a184 for instance 5661854e-8257-40d2-a5a1-44224818fe5c on hv-cinder-83754 Jun 16 18:13:11.955200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-08c7b97a-eca2-4154-b679-64578e1cc264 req-eede6557-e8f4-455c-a48f-15f0d2ed249f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035915 Jun 16 18:13:11.955868 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 358/718] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:12.475155 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:12.475860 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:12.483523 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:12.483967 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:12.484756 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:12.485197 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:12.525669 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:12.526037 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:12.526491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lazy-loading 'fault' on Instance uuid 279175ca-aad1-40da-a191-4712cbd17771 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:13:12.581478 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:12.591691 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:12.593250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:12.594418 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b3c44575-e6dd-4e80-9b09-825dd1479d9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1370 microversion: 2.20 time: 0.124366 Jun 16 18:13:12.595013 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 361/719] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:12 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1370 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:12.666851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-94de56b5-45f8-4f5b-9a01-5525484fe073 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:12.667584 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-94de56b5-45f8-4f5b-9a01-5525484fe073 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:12.676771 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-94de56b5-45f8-4f5b-9a01-5525484fe073 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:12.677213 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-94de56b5-45f8-4f5b-9a01-5525484fe073 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:12.678098 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-94de56b5-45f8-4f5b-9a01-5525484fe073 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:12.678524 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-94de56b5-45f8-4f5b-9a01-5525484fe073 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:12.856837 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-94de56b5-45f8-4f5b-9a01-5525484fe073 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:12.865572 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-94de56b5-45f8-4f5b-9a01-5525484fe073 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1689 microversion: 2.1 time: 0.203234 Jun 16 18:13:12.866165 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 359/720] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:12 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1689 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:13.614427 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:13.615063 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:13.622210 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:13.622674 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:13.623491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:13.623934 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:13.656748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:13.657190 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:13.657645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lazy-loading 'fault' on Instance uuid 279175ca-aad1-40da-a191-4712cbd17771 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:13:13.703165 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:13.716664 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:13.719206 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:13.721215 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b0bd4a3c-3fb8-4c2e-9c90-1d4ad617ea92 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 200 len: 1370 microversion: 2.20 time: 0.110991 Jun 16 18:13:13.722199 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 362/721] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:13 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 1370 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:13.887897 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-28e365df-b579-4ac6-9588-66fcb12e5e1a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:13.888531 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-28e365df-b579-4ac6-9588-66fcb12e5e1a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:13.897533 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-28e365df-b579-4ac6-9588-66fcb12e5e1a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:13.898116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-28e365df-b579-4ac6-9588-66fcb12e5e1a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:13.898931 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-28e365df-b579-4ac6-9588-66fcb12e5e1a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:13.899507 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-28e365df-b579-4ac6-9588-66fcb12e5e1a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:14.055084 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-28e365df-b579-4ac6-9588-66fcb12e5e1a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:14.065063 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-28e365df-b579-4ac6-9588-66fcb12e5e1a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1689 microversion: 2.1 time: 0.182001 Jun 16 18:13:14.066682 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 360/722] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:13 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:14.743643 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-36e2dfb3-f357-486c-9086-0bf5ef607d7e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:14.744258 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-36e2dfb3-f357-486c-9086-0bf5ef607d7e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:14.751133 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-36e2dfb3-f357-486c-9086-0bf5ef607d7e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:14.751630 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-36e2dfb3-f357-486c-9086-0bf5ef607d7e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:14.752410 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-36e2dfb3-f357-486c-9086-0bf5ef607d7e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:14.752841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-36e2dfb3-f357-486c-9086-0bf5ef607d7e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:14.769996 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-36e2dfb3-f357-486c-9086-0bf5ef607d7e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] HTTP exception thrown: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-36e2dfb3-f357-486c-9086-0bf5ef607d7e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Request method failure captured: Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 HTTP/1.1 Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E0DLFAzueFCRyIOI_Wamcopl8BPhZjhyXF5i3gaLx65IHRBB3NLvtjkKNFypU4raCiEo3zxARXdw3R8WCKDEUqiKq7KT-reEK7LcUQCbH2ITH7OzfsKqzEUI8VK4v2Pf3oENG-wt4cY3NFptHmG70LNOTwWOmDqhut9bWDnW3uRAo Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 11089493792047939c9f45f632a0ce05 Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:13:14.772033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:13:14.773808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11089493792047939c9f45f632a0ce05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11089493792047939c9f45f632a0ce05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11089493792047939c9f45f632a0ce05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11089493792047939c9f45f632a0ce05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:13:14.773808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:13:14.773808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 11089493792047939c9f45f632a0ce05 Jun 16 18:13:14.773808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:13:14.773808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeShelveTestJSON-1970635677-project Jun 16 18:13:14.773808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:13:14.773808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:13:14.773808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 30ac12728e8f4ec9af534612030d75eb Jun 16 18:13:14.773808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1970635677-project Jun 16 18:13:14.773808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:13:14.773808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:13:14.773808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '279175ca-aad1-40da-a191-4712cbd17771'} Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:13:14.774780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:13:14.776078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:14.777141 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-36e2dfb3-f357-486c-9086-0bf5ef607d7e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Returning 404 to user: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:13:14.777141 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-36e2dfb3-f357-486c-9086-0bf5ef607d7e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 404 len: 111 microversion: 2.20 time: 0.034273 Jun 16 18:13:14.777141 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 363/723] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:14 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:13:14.783943 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-79938a32-213a-425e-ae99-c553e43c3aca tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '.version_select at 0x7f9c304c3a60>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:14.881583 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-79938a32-213a-425e-ae99-c553e43c3aca tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109035206" status: 204 len: 0 microversion: 2.20 time: 0.101835 Jun 16 18:13:14.882373 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 361/724] 10.222.0.58 () {60 vars in 1261 bytes} [Thu Jun 16 18:13:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109035206 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:13:15.086057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5e8bd4ca-2438-4818-816f-e9835b6416ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:15.086955 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5e8bd4ca-2438-4818-816f-e9835b6416ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:15.089382 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:15.098502 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5e8bd4ca-2438-4818-816f-e9835b6416ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:15.102366 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5e8bd4ca-2438-4818-816f-e9835b6416ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:15.106189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5e8bd4ca-2438-4818-816f-e9835b6416ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:15.106667 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5e8bd4ca-2438-4818-816f-e9835b6416ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:15.316722 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5e8bd4ca-2438-4818-816f-e9835b6416ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:15.333664 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5e8bd4ca-2438-4818-816f-e9835b6416ba tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1621 microversion: 2.1 time: 0.251714 Jun 16 18:13:15.349359 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 364/725] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:15 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1621 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:15.688524 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-a8c86dda-48f6-4054-adac-027da82714d3 req-3edd4e24-ed3e-429a-9616-58920752653c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2de096-32e0-4f4e-835d-4e3ba69263c9", "name": "network-vif-deleted", "tag": "b98b0ab2-3cdd-47a1-b37c-1d29f9464d66"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:15.698421 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-a8c86dda-48f6-4054-adac-027da82714d3 req-3edd4e24-ed3e-429a-9616-58920752653c service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:15.698904 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-a8c86dda-48f6-4054-adac-027da82714d3 req-3edd4e24-ed3e-429a-9616-58920752653c service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:15.713759 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-a8c86dda-48f6-4054-adac-027da82714d3 req-3edd4e24-ed3e-429a-9616-58920752653c service nova] Creating event network-vif-deleted:b98b0ab2-3cdd-47a1-b37c-1d29f9464d66 for instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 on hv-cinder-83754 Jun 16 18:13:15.723523 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-a8c86dda-48f6-4054-adac-027da82714d3 req-3edd4e24-ed3e-429a-9616-58920752653c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040121 Jun 16 18:13:15.724518 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 362/726] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:16.326573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d7d54239-ebbd-430b-a3d4-68133cb231b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Action: 'create', calling method: .version_select at 0x7f9c23d1fa60>, body: {"keypair": {"name": "tempest-keypair-678770000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmEERYCOVwP+z4JQpIhFrZCNcRVVi9rQAcmR4Y8ijKYyPpUsgfKso+HEVhFvc8AmueKxJ5eofA7K1wA24mseVlGjZsayGhBWNd5KLieE/xT7EIvJygBdnDteN8O8dNnQw=="}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:16.345825 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-d7d54239-ebbd-430b-a3d4-68133cb231b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Getting quotas for project 11089493792047939c9f45f632a0ce05. Resources: {'key_pairs'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:13:16.350981 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-d7d54239-ebbd-430b-a3d4-68133cb231b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Getting quotas for user 30ac12728e8f4ec9af534612030d75eb and project 11089493792047939c9f45f632a0ce05. Resources: {'key_pairs'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:13:16.364127 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2339f3fe-06b8-49c1-87e3-572dbd23808d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:16.365339 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2339f3fe-06b8-49c1-87e3-572dbd23808d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:16.376566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2339f3fe-06b8-49c1-87e3-572dbd23808d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:16.377275 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2339f3fe-06b8-49c1-87e3-572dbd23808d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:16.378961 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2339f3fe-06b8-49c1-87e3-572dbd23808d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:16.379998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2339f3fe-06b8-49c1-87e3-572dbd23808d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:16.426577 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2339f3fe-06b8-49c1-87e3-572dbd23808d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:16.427202 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2339f3fe-06b8-49c1-87e3-572dbd23808d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:16.427692 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-2339f3fe-06b8-49c1-87e3-572dbd23808d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lazy-loading 'fault' on Instance uuid 1b2de096-32e0-4f4e-835d-4e3ba69263c9 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:13:16.456046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d7d54239-ebbd-430b-a3d4-68133cb231b6 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.133554 Jun 16 18:13:16.458302 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 365/727] 10.222.0.58 () {62 vars in 1199 bytes} [Thu Jun 16 18:13:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:13:16.486713 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2339f3fe-06b8-49c1-87e3-572dbd23808d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:16.496157 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2339f3fe-06b8-49c1-87e3-572dbd23808d tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 200 len: 1335 microversion: 2.1 time: 0.140951 Jun 16 18:13:16.497516 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 363/728] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:16 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 1335 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:17.523512 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-19e6abf4-f84b-4eee-97a3-05ad55f0fba2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:17.524266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-19e6abf4-f84b-4eee-97a3-05ad55f0fba2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 1b2de096-32e0-4f4e-835d-4e3ba69263c9] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:17.531889 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-19e6abf4-f84b-4eee-97a3-05ad55f0fba2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:17.532778 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-19e6abf4-f84b-4eee-97a3-05ad55f0fba2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:17.533873 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-19e6abf4-f84b-4eee-97a3-05ad55f0fba2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:17.534320 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-19e6abf4-f84b-4eee-97a3-05ad55f0fba2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:17.551550 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-19e6abf4-f84b-4eee-97a3-05ad55f0fba2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] HTTP exception thrown: Instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 could not be found. Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-19e6abf4-f84b-4eee-97a3-05ad55f0fba2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Request method failure captured: Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 HTTP/1.1 Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3Eq-J0cdT7Q59NKUoZ9-m6io95jrja4nBlLZ2IrmHPjQUc437edozQeIknUqxjH4oxU4tdk87XU_tl9vD01b67d4jh_u74_xK6DIe9tZ4bSiOiMPWaTlez9oD4PgPfEkuLcgt5L68flaxEHxw0SGv-tm0UCwE2jS56Nebwkx8ox4Bg Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: b566750533af4d0d96a3d0e0ffbc45ed Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:13:17.553321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:13:17.555838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:13:17.555838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:13:17.555838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: b566750533af4d0d96a3d0e0ffbc45ed Jun 16 18:13:17.555838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:13:17.555838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-ServerRescueNegativeTestJSON-1069596980-project Jun 16 18:13:17.555838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:13:17.555838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:13:17.555838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 70d6f15465b84182a28d96d1808a9660 Jun 16 18:13:17.555838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1069596980-project Jun 16 18:13:17.555838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:13:17.555838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 could not be found. Jun 16 18:13:17.555838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '1b2de096-32e0-4f4e-835d-4e3ba69263c9'} Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 could not be found. Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:13:17.556983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 could not be found. Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 could not be found. Jun 16 18:13:17.559486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:17.561651 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-19e6abf4-f84b-4eee-97a3-05ad55f0fba2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Returning 404 to user: Instance 1b2de096-32e0-4f4e-835d-4e3ba69263c9 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:13:17.561651 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-19e6abf4-f84b-4eee-97a3-05ad55f0fba2 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9" status: 404 len: 111 microversion: 2.1 time: 0.035833 Jun 16 18:13:17.561651 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 366/729] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:17 2022] GET /compute/v2.1/servers/1b2de096-32e0-4f4e-835d-4e3ba69263c9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:13:17.564087 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6dcbd5c0-e9ba-4a99-bb54-848ed4b139c5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '.version_select at 0x7f9c3040c550>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:17.571546 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:17.703569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6dcbd5c0-e9ba-4a99-bb54-848ed4b139c5 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-308991458" status: 202 len: 0 microversion: 2.1 time: 0.143437 Jun 16 18:13:17.704153 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 364/730] 10.222.0.58 () {58 vars in 1217 bytes} [Thu Jun 16 18:13:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-308991458 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:13:19.648738 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1428072145", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96883365-6ff9-48c2-aa63-6859af6f797f"}], "security_groups": [{"name": "tempest-securitygroup--1462338331"}], "key_name": "tempest-keypair-678770000", "user_data": "}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:19.783292 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.network.neutron [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] validate_networks() for [('96883365-6ff9-48c2-aa63-6859af6f797f', None, None, None, None, None)] {{(pid=118162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:13:20.261276 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Flavor limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:13:20.262076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Image limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:13:20.262659 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Flavor pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:13:20.263437 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Image pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:13:20.263801 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:13:20.276078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:20.276676 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:20.281210 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:20.281210 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:20.296369 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Getting quotas for project 11089493792047939c9f45f632a0ce05. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:13:20.301088 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Getting quotas for user 30ac12728e8f4ec9af534612030d75eb and project 11089493792047939c9f45f632a0ce05. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:13:20.318109 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Going to run 1 instances... {{(pid=118162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:13:20.320417 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:13:20.502737 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [c4deccb2-ca80-4d5a-befb-a3836be936ae] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 18:13:21.512115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO oslo.messaging._drivers.impl_rabbit [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [c4deccb2-ca80-4d5a-befb-a3836be936ae] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 47780. Jun 16 18:13:21.516441 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3e556d1e-d162-4cf1-b9d4-8fd5aefac16d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.874817 Jun 16 18:13:21.517085 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 367/731] 10.222.0.58 () {62 vars in 1187 bytes} [Thu Jun 16 18:13:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:13:21.537418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-29404bb9-db89-43c3-b74b-02725071627a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:21.538556 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-29404bb9-db89-43c3-b74b-02725071627a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:21.604535 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-29404bb9-db89-43c3-b74b-02725071627a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:21.616282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-29404bb9-db89-43c3-b74b-02725071627a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:21.617484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-29404bb9-db89-43c3-b74b-02725071627a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:21.618826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-29404bb9-db89-43c3-b74b-02725071627a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1281 microversion: 2.20 time: 0.090955 Jun 16 18:13:21.619390 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 365/732] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:21 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:21.655115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-00d7325b-3ac7-4387-8bcd-15bf43b5c02a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:21.655841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-00d7325b-3ac7-4387-8bcd-15bf43b5c02a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:21.664805 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-00d7325b-3ac7-4387-8bcd-15bf43b5c02a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:21.665247 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-00d7325b-3ac7-4387-8bcd-15bf43b5c02a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:21.666053 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-00d7325b-3ac7-4387-8bcd-15bf43b5c02a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:21.666447 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-00d7325b-3ac7-4387-8bcd-15bf43b5c02a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:21.707515 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-00d7325b-3ac7-4387-8bcd-15bf43b5c02a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Going to try to terminate instance {{(pid=118162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:13:22.039846 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-00d7325b-3ac7-4387-8bcd-15bf43b5c02a tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 204 len: 0 microversion: 2.1 time: 0.392727 Jun 16 18:13:22.040432 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 368/733] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:13:21 2022] DELETE /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:13:22.048396 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-87513609-e869-496a-b0c7-4e8fc83c4796 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:22.049040 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-87513609-e869-496a-b0c7-4e8fc83c4796 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:22.057128 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-87513609-e869-496a-b0c7-4e8fc83c4796 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:22.057583 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-87513609-e869-496a-b0c7-4e8fc83c4796 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:22.058347 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-87513609-e869-496a-b0c7-4e8fc83c4796 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:22.058806 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-87513609-e869-496a-b0c7-4e8fc83c4796 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:22.224283 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-87513609-e869-496a-b0c7-4e8fc83c4796 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:22.237153 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-87513609-e869-496a-b0c7-4e8fc83c4796 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1506 microversion: 2.1 time: 0.191871 Jun 16 18:13:22.238870 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 366/734] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:22 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1506 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:22.642624 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-173f73ce-1eff-4016-8536-db3ed8eee3f2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:22.643942 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-173f73ce-1eff-4016-8536-db3ed8eee3f2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:22.654656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-173f73ce-1eff-4016-8536-db3ed8eee3f2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:22.655453 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-173f73ce-1eff-4016-8536-db3ed8eee3f2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:22.656776 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-173f73ce-1eff-4016-8536-db3ed8eee3f2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:22.657664 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-173f73ce-1eff-4016-8536-db3ed8eee3f2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:22.728924 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-173f73ce-1eff-4016-8536-db3ed8eee3f2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:22.737116 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-173f73ce-1eff-4016-8536-db3ed8eee3f2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:22.742334 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-173f73ce-1eff-4016-8536-db3ed8eee3f2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:22.742334 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-173f73ce-1eff-4016-8536-db3ed8eee3f2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1285 microversion: 2.20 time: 0.105710 Jun 16 18:13:22.742334 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 369/735] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:22 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:23.261138 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-572de462-271c-4d84-9a35-fbe2b7bd8637 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:23.261937 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-572de462-271c-4d84-9a35-fbe2b7bd8637 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:23.268690 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-572de462-271c-4d84-9a35-fbe2b7bd8637 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:23.269168 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-572de462-271c-4d84-9a35-fbe2b7bd8637 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:23.270488 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-572de462-271c-4d84-9a35-fbe2b7bd8637 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:23.271067 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-572de462-271c-4d84-9a35-fbe2b7bd8637 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:23.424676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-572de462-271c-4d84-9a35-fbe2b7bd8637 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:23.432859 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-572de462-271c-4d84-9a35-fbe2b7bd8637 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1506 microversion: 2.1 time: 0.176289 Jun 16 18:13:23.433505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 367/736] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:23 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:23.650254 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-d38b3899-eb90-4278-9902-347e8b8a6e04 req-76878e91-f9dc-4183-a43f-7bd6c21f2989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e8a4704-5fc6-45e0-901c-a972411b4d0c", "name": "network-vif-deleted", "tag": "4dd40206-bc4d-4054-80c9-ae713a416d7a"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:23.670999 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-d38b3899-eb90-4278-9902-347e8b8a6e04 req-76878e91-f9dc-4183-a43f-7bd6c21f2989 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:23.671465 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-d38b3899-eb90-4278-9902-347e8b8a6e04 req-76878e91-f9dc-4183-a43f-7bd6c21f2989 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:23.688786 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-d38b3899-eb90-4278-9902-347e8b8a6e04 req-76878e91-f9dc-4183-a43f-7bd6c21f2989 service nova] Creating event network-vif-deleted:4dd40206-bc4d-4054-80c9-ae713a416d7a for instance 5e8a4704-5fc6-45e0-901c-a972411b4d0c on hv-cinder-83754 Jun 16 18:13:23.696056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-d38b3899-eb90-4278-9902-347e8b8a6e04 req-76878e91-f9dc-4183-a43f-7bd6c21f2989 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050184 Jun 16 18:13:23.696656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 370/737] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:23.762076 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-4495c3c5-9448-42a7-8c29-9524185613e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:23.763319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-4495c3c5-9448-42a7-8c29-9524185613e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:23.773552 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4495c3c5-9448-42a7-8c29-9524185613e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:23.773997 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4495c3c5-9448-42a7-8c29-9524185613e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:23.774771 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4495c3c5-9448-42a7-8c29-9524185613e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:23.775199 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4495c3c5-9448-42a7-8c29-9524185613e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:23.778042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:23.851780 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4495c3c5-9448-42a7-8c29-9524185613e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:23.863691 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4495c3c5-9448-42a7-8c29-9524185613e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:23.865388 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4495c3c5-9448-42a7-8c29-9524185613e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:23.866846 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-4495c3c5-9448-42a7-8c29-9524185613e7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1333 microversion: 2.20 time: 0.111084 Jun 16 18:13:23.867673 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 368/738] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:23 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1333 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:13:24.451068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b36e0a08-c39d-4422-a053-01d453a86b54 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:24.451728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b36e0a08-c39d-4422-a053-01d453a86b54 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:24.458490 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b36e0a08-c39d-4422-a053-01d453a86b54 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:24.458940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b36e0a08-c39d-4422-a053-01d453a86b54 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:24.459953 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b36e0a08-c39d-4422-a053-01d453a86b54 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:24.460585 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b36e0a08-c39d-4422-a053-01d453a86b54 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:24.495801 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b36e0a08-c39d-4422-a053-01d453a86b54 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:24.496249 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b36e0a08-c39d-4422-a053-01d453a86b54 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:24.496701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-b36e0a08-c39d-4422-a053-01d453a86b54 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lazy-loading 'fault' on Instance uuid 5e8a4704-5fc6-45e0-901c-a972411b4d0c {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:13:24.549265 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b36e0a08-c39d-4422-a053-01d453a86b54 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:24.562847 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b36e0a08-c39d-4422-a053-01d453a86b54 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 200 len: 1310 microversion: 2.1 time: 0.116230 Jun 16 18:13:24.563698 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 371/739] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:24 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 1310 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:24.897144 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-309d8339-d631-49a7-85fc-020328f6892e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:24.897953 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-309d8339-d631-49a7-85fc-020328f6892e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:24.908889 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-309d8339-d631-49a7-85fc-020328f6892e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:24.909410 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-309d8339-d631-49a7-85fc-020328f6892e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:24.910958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-309d8339-d631-49a7-85fc-020328f6892e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:24.911513 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-309d8339-d631-49a7-85fc-020328f6892e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:25.100089 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-309d8339-d631-49a7-85fc-020328f6892e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:25.115440 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-309d8339-d631-49a7-85fc-020328f6892e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:25.118175 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-309d8339-d631-49a7-85fc-020328f6892e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:25.120287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-309d8339-d631-49a7-85fc-020328f6892e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1407 microversion: 2.20 time: 0.227932 Jun 16 18:13:25.121351 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 369/740] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:24 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:25.581899 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-39c80ab0-1b6e-4869-8b3a-5310e408150b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:25.583099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-39c80ab0-1b6e-4869-8b3a-5310e408150b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 5e8a4704-5fc6-45e0-901c-a972411b4d0c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:25.591635 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-39c80ab0-1b6e-4869-8b3a-5310e408150b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:25.593626 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-39c80ab0-1b6e-4869-8b3a-5310e408150b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:25.596323 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-39c80ab0-1b6e-4869-8b3a-5310e408150b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:25.596772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-39c80ab0-1b6e-4869-8b3a-5310e408150b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:25.611876 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-39c80ab0-1b6e-4869-8b3a-5310e408150b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] HTTP exception thrown: Instance 5e8a4704-5fc6-45e0-901c-a972411b4d0c could not be found. Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-39c80ab0-1b6e-4869-8b3a-5310e408150b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Request method failure captured: Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c HTTP/1.1 Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3Eq-J0cdT7Q59NKUoZ9-m6io95jrja4nBlLZ2IrmHPjQUc437edozQeIknUqxjH4oxU4tdk87XU_tl9vD01b67d4jh_u74_xK6DIe9tZ4bSiOiMPWaTlez9oD4PgPfEkuLcgt5L68flaxEHxw0SGv-tm0UCwE2jS56Nebwkx8ox4Bg Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: b566750533af4d0d96a3d0e0ffbc45ed Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:13:25.614124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:13:25.615646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:13:25.615646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:13:25.615646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: b566750533af4d0d96a3d0e0ffbc45ed Jun 16 18:13:25.615646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:13:25.615646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-ServerRescueNegativeTestJSON-1069596980-project Jun 16 18:13:25.615646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:13:25.615646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:13:25.615646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 70d6f15465b84182a28d96d1808a9660 Jun 16 18:13:25.615646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1069596980-project Jun 16 18:13:25.615646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:13:25.615646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 5e8a4704-5fc6-45e0-901c-a972411b4d0c could not be found. Jun 16 18:13:25.615646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '5e8a4704-5fc6-45e0-901c-a972411b4d0c'} Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e8a4704-5fc6-45e0-901c-a972411b4d0c could not be found. Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:13:25.620573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e8a4704-5fc6-45e0-901c-a972411b4d0c could not be found. Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e8a4704-5fc6-45e0-901c-a972411b4d0c could not be found. Jun 16 18:13:25.621945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:25.623433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-39c80ab0-1b6e-4869-8b3a-5310e408150b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Returning 404 to user: Instance 5e8a4704-5fc6-45e0-901c-a972411b4d0c could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:13:25.623433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-39c80ab0-1b6e-4869-8b3a-5310e408150b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c" status: 404 len: 111 microversion: 2.1 time: 0.038012 Jun 16 18:13:25.623433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 372/741] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:25 2022] GET /compute/v2.1/servers/5e8a4704-5fc6-45e0-901c-a972411b4d0c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:13:25.626809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ce9c9224-cf3f-4d0d-9307-39ebd361d62c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:25.627405 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ce9c9224-cf3f-4d0d-9307-39ebd361d62c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:25.637649 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce9c9224-cf3f-4d0d-9307-39ebd361d62c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:25.638234 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce9c9224-cf3f-4d0d-9307-39ebd361d62c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:25.639037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce9c9224-cf3f-4d0d-9307-39ebd361d62c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:25.639566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce9c9224-cf3f-4d0d-9307-39ebd361d62c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:25.681934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ce9c9224-cf3f-4d0d-9307-39ebd361d62c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Going to try to terminate instance {{(pid=118161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:13:25.999043 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-21e36420-2d62-478d-8a48-3a9e8434405c req-c6a3ce3a-c38a-4542-9aad-bca3c22bea4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4792d5b1-2139-4dc1-b191-7975b01fc093", "tag": "7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:26.016488 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-21e36420-2d62-478d-8a48-3a9e8434405c req-c6a3ce3a-c38a-4542-9aad-bca3c22bea4e service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:26.016813 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-21e36420-2d62-478d-8a48-3a9e8434405c req-c6a3ce3a-c38a-4542-9aad-bca3c22bea4e service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:26.028108 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ce9c9224-cf3f-4d0d-9307-39ebd361d62c tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 204 len: 0 microversion: 2.1 time: 0.406804 Jun 16 18:13:26.029851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 370/742] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:13:25 2022] DELETE /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:13:26.039292 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5bcc1c9a-e711-4df3-a4ab-ecdc66ec66aa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:26.040029 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5bcc1c9a-e711-4df3-a4ab-ecdc66ec66aa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:26.044238 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-21e36420-2d62-478d-8a48-3a9e8434405c req-c6a3ce3a-c38a-4542-9aad-bca3c22bea4e service nova] Creating event network-changed:7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e for instance 4792d5b1-2139-4dc1-b191-7975b01fc093 on hv-cinder-83754 Jun 16 18:13:26.051436 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-21e36420-2d62-478d-8a48-3a9e8434405c req-c6a3ce3a-c38a-4542-9aad-bca3c22bea4e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055898 Jun 16 18:13:26.052419 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 373/743] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:13:26.055511 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5bcc1c9a-e711-4df3-a4ab-ecdc66ec66aa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:26.061934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5bcc1c9a-e711-4df3-a4ab-ecdc66ec66aa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:26.061934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5bcc1c9a-e711-4df3-a4ab-ecdc66ec66aa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:26.061934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5bcc1c9a-e711-4df3-a4ab-ecdc66ec66aa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:26.148744 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-623c8504-2302-4aa7-9b47-facf6d843b2e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:26.149852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-623c8504-2302-4aa7-9b47-facf6d843b2e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:26.157717 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-623c8504-2302-4aa7-9b47-facf6d843b2e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:26.158337 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-623c8504-2302-4aa7-9b47-facf6d843b2e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:26.159350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-623c8504-2302-4aa7-9b47-facf6d843b2e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:26.160012 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-623c8504-2302-4aa7-9b47-facf6d843b2e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:26.268045 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5bcc1c9a-e711-4df3-a4ab-ecdc66ec66aa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:26.275809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5bcc1c9a-e711-4df3-a4ab-ecdc66ec66aa tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.241250 Jun 16 18:13:26.276395 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 371/744] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:26 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:26.335940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-623c8504-2302-4aa7-9b47-facf6d843b2e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:26.344547 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-623c8504-2302-4aa7-9b47-facf6d843b2e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:26.348349 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-623c8504-2302-4aa7-9b47-facf6d843b2e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:26.348349 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-623c8504-2302-4aa7-9b47-facf6d843b2e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1407 microversion: 2.20 time: 0.203978 Jun 16 18:13:26.348349 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 374/745] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:26 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:27.302694 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c8dbd9e1-8f52-4cd1-9371-dac23df06d2e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:27.303304 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c8dbd9e1-8f52-4cd1-9371-dac23df06d2e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:27.310992 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c8dbd9e1-8f52-4cd1-9371-dac23df06d2e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:27.311930 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c8dbd9e1-8f52-4cd1-9371-dac23df06d2e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:27.312723 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c8dbd9e1-8f52-4cd1-9371-dac23df06d2e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:27.313156 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c8dbd9e1-8f52-4cd1-9371-dac23df06d2e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:27.366417 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8ff73e94-9d29-442e-bdd2-741ee106f175 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:27.367176 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8ff73e94-9d29-442e-bdd2-741ee106f175 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:27.373943 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8ff73e94-9d29-442e-bdd2-741ee106f175 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:27.374389 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8ff73e94-9d29-442e-bdd2-741ee106f175 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:27.375191 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8ff73e94-9d29-442e-bdd2-741ee106f175 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:27.375651 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8ff73e94-9d29-442e-bdd2-741ee106f175 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:27.496841 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c8dbd9e1-8f52-4cd1-9371-dac23df06d2e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:27.507148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c8dbd9e1-8f52-4cd1-9371-dac23df06d2e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.208337 Jun 16 18:13:27.507944 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 372/746] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:27 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:27.544718 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8ff73e94-9d29-442e-bdd2-741ee106f175 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:27.553148 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8ff73e94-9d29-442e-bdd2-741ee106f175 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:27.554650 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8ff73e94-9d29-442e-bdd2-741ee106f175 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:27.555793 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8ff73e94-9d29-442e-bdd2-741ee106f175 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1407 microversion: 2.20 time: 0.193739 Jun 16 18:13:27.556345 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 375/747] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:27 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:13:28.530233 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-248947a8-195b-4114-88b6-fb2ba510bd4e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:28.531432 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-248947a8-195b-4114-88b6-fb2ba510bd4e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:28.539142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-248947a8-195b-4114-88b6-fb2ba510bd4e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:28.539622 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-248947a8-195b-4114-88b6-fb2ba510bd4e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:28.540395 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-248947a8-195b-4114-88b6-fb2ba510bd4e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:28.540825 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-248947a8-195b-4114-88b6-fb2ba510bd4e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:28.574302 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4770ef4a-8dec-4877-b2fc-2e3d42f3fbae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:28.575152 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4770ef4a-8dec-4877-b2fc-2e3d42f3fbae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:28.583792 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4770ef4a-8dec-4877-b2fc-2e3d42f3fbae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:28.584312 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4770ef4a-8dec-4877-b2fc-2e3d42f3fbae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:28.585198 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4770ef4a-8dec-4877-b2fc-2e3d42f3fbae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:28.585691 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4770ef4a-8dec-4877-b2fc-2e3d42f3fbae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:28.732661 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-248947a8-195b-4114-88b6-fb2ba510bd4e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:28.745563 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-248947a8-195b-4114-88b6-fb2ba510bd4e tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1522 microversion: 2.1 time: 0.218997 Jun 16 18:13:28.751519 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 373/748] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:28 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:28.762577 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4770ef4a-8dec-4877-b2fc-2e3d42f3fbae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:28.771555 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4770ef4a-8dec-4877-b2fc-2e3d42f3fbae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:28.773083 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4770ef4a-8dec-4877-b2fc-2e3d42f3fbae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:28.774197 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4770ef4a-8dec-4877-b2fc-2e3d42f3fbae tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1407 microversion: 2.20 time: 0.203772 Jun 16 18:13:28.774763 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 376/749] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:28 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:13:29.765965 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0cdba070-7a83-4d14-90ab-23c2e5252e31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:29.766724 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0cdba070-7a83-4d14-90ab-23c2e5252e31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:29.792472 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-40e28a5a-bfcd-4c86-9736-b2d6afe9f466 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:29.794034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-40e28a5a-bfcd-4c86-9736-b2d6afe9f466 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:29.799984 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0cdba070-7a83-4d14-90ab-23c2e5252e31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:29.800441 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0cdba070-7a83-4d14-90ab-23c2e5252e31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:29.801802 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0cdba070-7a83-4d14-90ab-23c2e5252e31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:29.803993 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-40e28a5a-bfcd-4c86-9736-b2d6afe9f466 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:29.808048 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-40e28a5a-bfcd-4c86-9736-b2d6afe9f466 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:29.808686 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0cdba070-7a83-4d14-90ab-23c2e5252e31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:29.810276 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-40e28a5a-bfcd-4c86-9736-b2d6afe9f466 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:29.814875 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-40e28a5a-bfcd-4c86-9736-b2d6afe9f466 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:29.953490 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0cdba070-7a83-4d14-90ab-23c2e5252e31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:29.962202 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0cdba070-7a83-4d14-90ab-23c2e5252e31 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1480 microversion: 2.1 time: 0.202184 Jun 16 18:13:29.962959 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 374/750] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:29 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1480 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:29.968918 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-1854a3a0-4f35-4a7e-91d3-68847813c48a req-7803e00a-d3a2-432c-91ec-c6e8e2a63382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d859d92-dab1-47f8-85ba-1e86413ceec9", "name": "network-vif-deleted", "tag": "cb3429ba-4c67-4253-ae49-1e5ad7f17023"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:29.977559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-1854a3a0-4f35-4a7e-91d3-68847813c48a req-7803e00a-d3a2-432c-91ec-c6e8e2a63382 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:29.978174 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-1854a3a0-4f35-4a7e-91d3-68847813c48a req-7803e00a-d3a2-432c-91ec-c6e8e2a63382 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:29.993379 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-1854a3a0-4f35-4a7e-91d3-68847813c48a req-7803e00a-d3a2-432c-91ec-c6e8e2a63382 service nova] Creating event network-vif-deleted:cb3429ba-4c67-4253-ae49-1e5ad7f17023 for instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 on hv-cinder-83754 Jun 16 18:13:29.999795 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-1854a3a0-4f35-4a7e-91d3-68847813c48a req-7803e00a-d3a2-432c-91ec-c6e8e2a63382 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035381 Jun 16 18:13:30.009893 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 375/751] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:30.091163 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-40e28a5a-bfcd-4c86-9736-b2d6afe9f466 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:30.099707 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-40e28a5a-bfcd-4c86-9736-b2d6afe9f466 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:30.101223 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-40e28a5a-bfcd-4c86-9736-b2d6afe9f466 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:30.102330 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-40e28a5a-bfcd-4c86-9736-b2d6afe9f466 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1407 microversion: 2.20 time: 0.313864 Jun 16 18:13:30.102911 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 377/752] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:29 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:13:30.981243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0eb8f699-93fb-4756-ac3c-08bac36cfdd0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:30.982068 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0eb8f699-93fb-4756-ac3c-08bac36cfdd0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:30.988471 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0eb8f699-93fb-4756-ac3c-08bac36cfdd0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:30.988900 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0eb8f699-93fb-4756-ac3c-08bac36cfdd0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:30.989675 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0eb8f699-93fb-4756-ac3c-08bac36cfdd0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:30.990106 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0eb8f699-93fb-4756-ac3c-08bac36cfdd0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:31.058386 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0eb8f699-93fb-4756-ac3c-08bac36cfdd0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:31.066365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0eb8f699-93fb-4756-ac3c-08bac36cfdd0 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1307 microversion: 2.1 time: 0.089786 Jun 16 18:13:31.067762 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 376/753] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:30 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:31.121251 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-874c5b2c-a003-4fb5-ba24-f05f5752d846 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:31.122025 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-874c5b2c-a003-4fb5-ba24-f05f5752d846 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:31.124562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:31.125277 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=10 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:31.131771 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-874c5b2c-a003-4fb5-ba24-f05f5752d846 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:31.132247 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-874c5b2c-a003-4fb5-ba24-f05f5752d846 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:31.133044 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-874c5b2c-a003-4fb5-ba24-f05f5752d846 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:31.133475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-874c5b2c-a003-4fb5-ba24-f05f5752d846 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:31.150713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:31.278194 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-874c5b2c-a003-4fb5-ba24-f05f5752d846 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:31.287158 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-874c5b2c-a003-4fb5-ba24-f05f5752d846 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:31.288691 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-874c5b2c-a003-4fb5-ba24-f05f5752d846 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:31.289846 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-874c5b2c-a003-4fb5-ba24-f05f5752d846 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1407 microversion: 2.20 time: 0.173096 Jun 16 18:13:31.290404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 378/754] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:31 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:32.084609 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-20077a13-d9c4-4ab0-865b-d216ba25b750 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:32.085212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-20077a13-d9c4-4ab0-865b-d216ba25b750 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:32.087128 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:32.092395 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-20077a13-d9c4-4ab0-865b-d216ba25b750 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:32.092835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-20077a13-d9c4-4ab0-865b-d216ba25b750 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:32.093588 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-20077a13-d9c4-4ab0-865b-d216ba25b750 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:32.094013 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-20077a13-d9c4-4ab0-865b-d216ba25b750 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:32.157420 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-20077a13-d9c4-4ab0-865b-d216ba25b750 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:32.165154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-20077a13-d9c4-4ab0-865b-d216ba25b750 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1307 microversion: 2.1 time: 0.085072 Jun 16 18:13:32.165714 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 377/755] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:32 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1307 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:32.309063 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-641f25aa-d868-40d5-9b3f-d6cf5d28ee8b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:32.309689 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-641f25aa-d868-40d5-9b3f-d6cf5d28ee8b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:32.318680 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-641f25aa-d868-40d5-9b3f-d6cf5d28ee8b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:32.319272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-641f25aa-d868-40d5-9b3f-d6cf5d28ee8b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:32.320069 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-641f25aa-d868-40d5-9b3f-d6cf5d28ee8b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:32.320502 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-641f25aa-d868-40d5-9b3f-d6cf5d28ee8b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:32.547609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-641f25aa-d868-40d5-9b3f-d6cf5d28ee8b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:32.557343 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-641f25aa-d868-40d5-9b3f-d6cf5d28ee8b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:32.558773 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-641f25aa-d868-40d5-9b3f-d6cf5d28ee8b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:32.559913 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-641f25aa-d868-40d5-9b3f-d6cf5d28ee8b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1407 microversion: 2.20 time: 0.255197 Jun 16 18:13:32.560493 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 379/756] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:32 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:33.182109 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-07a3bbee-bf31-44c0-93ff-1a3296ed1611 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:33.182830 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-07a3bbee-bf31-44c0-93ff-1a3296ed1611 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:33.189303 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07a3bbee-bf31-44c0-93ff-1a3296ed1611 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:33.189785 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07a3bbee-bf31-44c0-93ff-1a3296ed1611 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:33.190582 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07a3bbee-bf31-44c0-93ff-1a3296ed1611 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:33.191019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07a3bbee-bf31-44c0-93ff-1a3296ed1611 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:33.224091 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07a3bbee-bf31-44c0-93ff-1a3296ed1611 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:33.224538 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07a3bbee-bf31-44c0-93ff-1a3296ed1611 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:33.224990 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-07a3bbee-bf31-44c0-93ff-1a3296ed1611 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lazy-loading 'fault' on Instance uuid 6d859d92-dab1-47f8-85ba-1e86413ceec9 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:13:33.268702 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-07a3bbee-bf31-44c0-93ff-1a3296ed1611 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d6f15465b84182a28d96d1808a9660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b566750533af4d0d96a3d0e0ffbc45ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:33.276335 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-07a3bbee-bf31-44c0-93ff-1a3296ed1611 tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 200 len: 1312 microversion: 2.1 time: 0.098132 Jun 16 18:13:33.276905 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 378/757] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:33 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:33.579561 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-69d8873e-6522-4d27-b33b-dd7df1a749dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:33.579561 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-69d8873e-6522-4d27-b33b-dd7df1a749dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:33.587392 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-69d8873e-6522-4d27-b33b-dd7df1a749dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:33.588107 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-69d8873e-6522-4d27-b33b-dd7df1a749dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:33.589798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-69d8873e-6522-4d27-b33b-dd7df1a749dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:33.591028 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-69d8873e-6522-4d27-b33b-dd7df1a749dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:33.731910 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-69d8873e-6522-4d27-b33b-dd7df1a749dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:33.740087 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-69d8873e-6522-4d27-b33b-dd7df1a749dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:33.741579 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-69d8873e-6522-4d27-b33b-dd7df1a749dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:33.742691 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-69d8873e-6522-4d27-b33b-dd7df1a749dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1407 microversion: 2.20 time: 0.168392 Jun 16 18:13:33.743239 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 380/758] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:33 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:34.155616 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-08244adf-4a94-436e-a003-bbbc184ebded tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:34.156564 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-08244adf-4a94-436e-a003-bbbc184ebded tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:34.163754 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-08244adf-4a94-436e-a003-bbbc184ebded tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:34.164198 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-08244adf-4a94-436e-a003-bbbc184ebded tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:34.165041 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-08244adf-4a94-436e-a003-bbbc184ebded tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:34.165400 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-08244adf-4a94-436e-a003-bbbc184ebded tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:34.199860 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-08244adf-4a94-436e-a003-bbbc184ebded tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048204 Jun 16 18:13:34.200577 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 379/759] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:13:34 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:13:34.262345 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e420c560-94ba-4215-808b-dd45e0cdfc4c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:34.262866 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e420c560-94ba-4215-808b-dd45e0cdfc4c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:34.269231 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e420c560-94ba-4215-808b-dd45e0cdfc4c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:34.269732 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e420c560-94ba-4215-808b-dd45e0cdfc4c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:34.271277 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e420c560-94ba-4215-808b-dd45e0cdfc4c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:34.271741 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e420c560-94ba-4215-808b-dd45e0cdfc4c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:34.293989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0a2a2b11-4fa2-4f05-8f66-96090bb5cf9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:34.294598 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0a2a2b11-4fa2-4f05-8f66-96090bb5cf9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] [instance: 6d859d92-dab1-47f8-85ba-1e86413ceec9] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:34.298631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e420c560-94ba-4215-808b-dd45e0cdfc4c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Going to try to terminate instance {{(pid=118162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:13:34.305717 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0a2a2b11-4fa2-4f05-8f66-96090bb5cf9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:34.305717 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0a2a2b11-4fa2-4f05-8f66-96090bb5cf9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:34.305717 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0a2a2b11-4fa2-4f05-8f66-96090bb5cf9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:34.305717 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0a2a2b11-4fa2-4f05-8f66-96090bb5cf9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:34.318341 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-0a2a2b11-4fa2-4f05-8f66-96090bb5cf9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] HTTP exception thrown: Instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 could not be found. Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0a2a2b11-4fa2-4f05-8f66-96090bb5cf9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Request method failure captured: Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 HTTP/1.1 Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3Eq-J0cdT7Q59NKUoZ9-m6io95jrja4nBlLZ2IrmHPjQUc437edozQeIknUqxjH4oxU4tdk87XU_tl9vD01b67d4jh_u74_xK6DIe9tZ4bSiOiMPWaTlez9oD4PgPfEkuLcgt5L68flaxEHxw0SGv-tm0UCwE2jS56Nebwkx8ox4Bg Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: b566750533af4d0d96a3d0e0ffbc45ed Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:13:34.320037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:13:34.321721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b566750533af4d0d96a3d0e0ffbc45ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:13:34.321721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:13:34.321721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: b566750533af4d0d96a3d0e0ffbc45ed Jun 16 18:13:34.321721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1069596980 Jun 16 18:13:34.321721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-ServerRescueNegativeTestJSON-1069596980-project Jun 16 18:13:34.321721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:13:34.321721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:13:34.321721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 70d6f15465b84182a28d96d1808a9660 Jun 16 18:13:34.321721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1069596980-project Jun 16 18:13:34.321721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:13:34.321721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 could not be found. Jun 16 18:13:34.321721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '6d859d92-dab1-47f8-85ba-1e86413ceec9'} Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 could not be found. Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:13:34.322581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 could not be found. Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 could not be found. Jun 16 18:13:34.324291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:13:34.325598 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0a2a2b11-4fa2-4f05-8f66-96090bb5cf9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] Returning 404 to user: Instance 6d859d92-dab1-47f8-85ba-1e86413ceec9 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:13:34.325598 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0a2a2b11-4fa2-4f05-8f66-96090bb5cf9b tempest-ServerRescueNegativeTestJSON-1069596980 tempest-ServerRescueNegativeTestJSON-1069596980-project] 10.222.0.58 "GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9" status: 404 len: 111 microversion: 2.1 time: 0.031283 Jun 16 18:13:34.325598 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 380/760] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:34 2022] GET /compute/v2.1/servers/6d859d92-dab1-47f8-85ba-1e86413ceec9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:13:34.703750 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e420c560-94ba-4215-808b-dd45e0cdfc4c tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 204 len: 0 microversion: 2.1 time: 0.444681 Jun 16 18:13:34.704300 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 381/761] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:13:34 2022] DELETE /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:13:34.712707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f0fb90bb-4188-4335-9d71-e52d9f6c02b6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:34.713684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f0fb90bb-4188-4335-9d71-e52d9f6c02b6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:34.719710 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f0fb90bb-4188-4335-9d71-e52d9f6c02b6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:34.720148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f0fb90bb-4188-4335-9d71-e52d9f6c02b6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:34.720917 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f0fb90bb-4188-4335-9d71-e52d9f6c02b6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:34.721348 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f0fb90bb-4188-4335-9d71-e52d9f6c02b6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:34.766675 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-03db45b9-cc23-4192-820a-f96c4ba1cd2d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:34.767809 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-03db45b9-cc23-4192-820a-f96c4ba1cd2d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:34.787396 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-03db45b9-cc23-4192-820a-f96c4ba1cd2d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:34.787860 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-03db45b9-cc23-4192-820a-f96c4ba1cd2d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:34.788637 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-03db45b9-cc23-4192-820a-f96c4ba1cd2d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:34.789067 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-03db45b9-cc23-4192-820a-f96c4ba1cd2d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:34.950269 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f0fb90bb-4188-4335-9d71-e52d9f6c02b6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:34.959215 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f0fb90bb-4188-4335-9d71-e52d9f6c02b6 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1672 microversion: 2.1 time: 0.250097 Jun 16 18:13:34.960448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 381/762] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:34 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1672 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:34.982409 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-03db45b9-cc23-4192-820a-f96c4ba1cd2d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:34.992322 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-03db45b9-cc23-4192-820a-f96c4ba1cd2d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:34.993747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-03db45b9-cc23-4192-820a-f96c4ba1cd2d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:34.994906 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-03db45b9-cc23-4192-820a-f96c4ba1cd2d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1407 microversion: 2.20 time: 0.235914 Jun 16 18:13:34.996796 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 382/763] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:34 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:35.080372 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-e7c7569f-f9fd-471d-adbc-9994bff3fb87 req-77d47afb-3a46-4e31-abcd-767ef53120d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4792d5b1-2139-4dc1-b191-7975b01fc093", "name": "network-vif-plugged", "status": "completed", "tag": "7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:35.093713 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-e7c7569f-f9fd-471d-adbc-9994bff3fb87 req-77d47afb-3a46-4e31-abcd-767ef53120d2 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:35.094156 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-e7c7569f-f9fd-471d-adbc-9994bff3fb87 req-77d47afb-3a46-4e31-abcd-767ef53120d2 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:35.107612 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-e7c7569f-f9fd-471d-adbc-9994bff3fb87 req-77d47afb-3a46-4e31-abcd-767ef53120d2 service nova] Creating event network-vif-plugged:7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e for instance 4792d5b1-2139-4dc1-b191-7975b01fc093 on hv-cinder-83754 Jun 16 18:13:35.112819 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-e7c7569f-f9fd-471d-adbc-9994bff3fb87 req-77d47afb-3a46-4e31-abcd-767ef53120d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036560 Jun 16 18:13:35.119437 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 382/764] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:13:35.979705 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0ed70e11-06d3-4ff3-a1f7-493b3c3efacb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:35.980517 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0ed70e11-06d3-4ff3-a1f7-493b3c3efacb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:35.987693 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ed70e11-06d3-4ff3-a1f7-493b3c3efacb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:35.989053 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ed70e11-06d3-4ff3-a1f7-493b3c3efacb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:35.990105 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ed70e11-06d3-4ff3-a1f7-493b3c3efacb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:35.990454 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-503dfd2f-66a8-4fa6-942d-bf469864d698 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:35.991390 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ed70e11-06d3-4ff3-a1f7-493b3c3efacb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:35.992283 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-503dfd2f-66a8-4fa6-942d-bf469864d698 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:35.999618 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-503dfd2f-66a8-4fa6-942d-bf469864d698 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:36.000201 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-503dfd2f-66a8-4fa6-942d-bf469864d698 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:36.000983 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-503dfd2f-66a8-4fa6-942d-bf469864d698 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:36.001414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-503dfd2f-66a8-4fa6-942d-bf469864d698 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:36.038407 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-503dfd2f-66a8-4fa6-942d-bf469864d698 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lazy-loading 'flavor' on Instance uuid df6c9426-2d6f-4dfb-8bc8-959827d8cf79 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:13:36.152628 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:36.288454 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0ed70e11-06d3-4ff3-a1f7-493b3c3efacb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:36.301447 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0ed70e11-06d3-4ff3-a1f7-493b3c3efacb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1672 microversion: 2.1 time: 0.327190 Jun 16 18:13:36.302352 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 383/765] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:35 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1672 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:36.307689 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-419619e6-8e8d-44fa-bb9a-ced7d3876d0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:36.308559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-419619e6-8e8d-44fa-bb9a-ced7d3876d0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:36.315414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-419619e6-8e8d-44fa-bb9a-ced7d3876d0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:36.317386 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-419619e6-8e8d-44fa-bb9a-ced7d3876d0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:36.317912 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-419619e6-8e8d-44fa-bb9a-ced7d3876d0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:36.318576 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-419619e6-8e8d-44fa-bb9a-ced7d3876d0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:36.397398 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-503dfd2f-66a8-4fa6-942d-bf469864d698 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "POST /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79/action" status: 202 len: 0 microversion: 2.1 time: 0.412816 Jun 16 18:13:36.402773 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 383/766] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:13:35 2022] POST /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:13:36.425887 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d497329e-bbf3-49ab-9dff-25197a6089e6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:36.433199 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d497329e-bbf3-49ab-9dff-25197a6089e6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:36.446552 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d497329e-bbf3-49ab-9dff-25197a6089e6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:36.447008 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d497329e-bbf3-49ab-9dff-25197a6089e6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:36.447819 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d497329e-bbf3-49ab-9dff-25197a6089e6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:36.448468 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d497329e-bbf3-49ab-9dff-25197a6089e6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:36.680717 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-419619e6-8e8d-44fa-bb9a-ced7d3876d0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:36.689564 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-419619e6-8e8d-44fa-bb9a-ced7d3876d0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:36.691396 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-419619e6-8e8d-44fa-bb9a-ced7d3876d0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:36.692917 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-419619e6-8e8d-44fa-bb9a-ced7d3876d0a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1407 microversion: 2.20 time: 0.389335 Jun 16 18:13:36.693678 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 384/767] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:36 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1407 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:36.778862 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d497329e-bbf3-49ab-9dff-25197a6089e6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:36.788462 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d497329e-bbf3-49ab-9dff-25197a6089e6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.381075 Jun 16 18:13:36.805378 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 384/768] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:36 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:37.320200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-daa5530f-6964-4679-9c18-52096ab29db1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:37.320815 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-daa5530f-6964-4679-9c18-52096ab29db1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:37.327806 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-daa5530f-6964-4679-9c18-52096ab29db1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:37.328256 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-daa5530f-6964-4679-9c18-52096ab29db1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:37.329029 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-daa5530f-6964-4679-9c18-52096ab29db1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:37.329459 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-daa5530f-6964-4679-9c18-52096ab29db1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:37.421140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-daa5530f-6964-4679-9c18-52096ab29db1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:37.428968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-daa5530f-6964-4679-9c18-52096ab29db1 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1605 microversion: 2.1 time: 0.112659 Jun 16 18:13:37.440337 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 385/769] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:37 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1605 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:37.539266 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-cef9b1b0-590f-4527-a942-2f3a1fa509f7 req-bd229d65-d975-478e-bd0c-346b33aa471f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1134706f-4520-434d-877f-bc6465b3e282", "name": "network-vif-deleted", "tag": "41a992ba-4fda-42d8-a121-3c7c2f9e6d3d"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:37.550948 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-cef9b1b0-590f-4527-a942-2f3a1fa509f7 req-bd229d65-d975-478e-bd0c-346b33aa471f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:37.552125 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-cef9b1b0-590f-4527-a942-2f3a1fa509f7 req-bd229d65-d975-478e-bd0c-346b33aa471f service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:37.565184 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-cef9b1b0-590f-4527-a942-2f3a1fa509f7 req-bd229d65-d975-478e-bd0c-346b33aa471f service nova] Creating event network-vif-deleted:41a992ba-4fda-42d8-a121-3c7c2f9e6d3d for instance 1134706f-4520-434d-877f-bc6465b3e282 on hv-cinder-83754 Jun 16 18:13:37.571933 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-cef9b1b0-590f-4527-a942-2f3a1fa509f7 req-bd229d65-d975-478e-bd0c-346b33aa471f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037711 Jun 16 18:13:37.572537 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 385/770] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:37.710434 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-7c441f01-424d-491f-a433-a85420abb9dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:37.711720 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-7c441f01-424d-491f-a433-a85420abb9dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:37.729813 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7c441f01-424d-491f-a433-a85420abb9dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:37.730082 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7c441f01-424d-491f-a433-a85420abb9dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:37.731114 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7c441f01-424d-491f-a433-a85420abb9dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:37.731926 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7c441f01-424d-491f-a433-a85420abb9dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:37.814060 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3c25aebf-7682-40cf-9279-6fd51969efdf tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:37.815224 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3c25aebf-7682-40cf-9279-6fd51969efdf tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:37.823790 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3c25aebf-7682-40cf-9279-6fd51969efdf tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:37.823790 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3c25aebf-7682-40cf-9279-6fd51969efdf tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:37.824138 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3c25aebf-7682-40cf-9279-6fd51969efdf tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:37.824766 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3c25aebf-7682-40cf-9279-6fd51969efdf tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:38.385086 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3c25aebf-7682-40cf-9279-6fd51969efdf tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:38.403494 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3c25aebf-7682-40cf-9279-6fd51969efdf tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.594165 Jun 16 18:13:38.404271 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 386/771] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:37 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:38.409938 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7c441f01-424d-491f-a433-a85420abb9dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:38.421330 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7c441f01-424d-491f-a433-a85420abb9dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:38.423722 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7c441f01-424d-491f-a433-a85420abb9dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:38.425097 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-7c441f01-424d-491f-a433-a85420abb9dd tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1407 microversion: 2.20 time: 0.718936 Jun 16 18:13:38.438842 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 386/772] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:37 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1407 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:38.447093 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-eaed9872-e08c-47f3-8dcc-bbd5887c57d9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:38.447900 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-eaed9872-e08c-47f3-8dcc-bbd5887c57d9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:38.455320 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eaed9872-e08c-47f3-8dcc-bbd5887c57d9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:38.456234 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eaed9872-e08c-47f3-8dcc-bbd5887c57d9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:38.457936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eaed9872-e08c-47f3-8dcc-bbd5887c57d9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:38.458915 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eaed9872-e08c-47f3-8dcc-bbd5887c57d9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:38.499050 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eaed9872-e08c-47f3-8dcc-bbd5887c57d9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:38.499050 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eaed9872-e08c-47f3-8dcc-bbd5887c57d9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:38.500492 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-eaed9872-e08c-47f3-8dcc-bbd5887c57d9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lazy-loading 'fault' on Instance uuid 1134706f-4520-434d-877f-bc6465b3e282 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:13:38.557205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-eaed9872-e08c-47f3-8dcc-bbd5887c57d9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:38.573707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-eaed9872-e08c-47f3-8dcc-bbd5887c57d9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 200 len: 1326 microversion: 2.1 time: 0.131281 Jun 16 18:13:38.584126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 387/773] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:38 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:39.425602 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-160b6641-a74c-4e97-9d1a-9cfe78a3194d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:39.426862 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-160b6641-a74c-4e97-9d1a-9cfe78a3194d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:39.438380 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-160b6641-a74c-4e97-9d1a-9cfe78a3194d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:39.438856 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-160b6641-a74c-4e97-9d1a-9cfe78a3194d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:39.439949 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-160b6641-a74c-4e97-9d1a-9cfe78a3194d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:39.440563 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-160b6641-a74c-4e97-9d1a-9cfe78a3194d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:39.447922 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-043c123d-6195-4862-be69-55746df9d822 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:39.449146 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-043c123d-6195-4862-be69-55746df9d822 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:39.459878 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-043c123d-6195-4862-be69-55746df9d822 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:39.460381 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-043c123d-6195-4862-be69-55746df9d822 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:39.462295 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-043c123d-6195-4862-be69-55746df9d822 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:39.463097 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-043c123d-6195-4862-be69-55746df9d822 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:39.748233 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-160b6641-a74c-4e97-9d1a-9cfe78a3194d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:39.762463 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-160b6641-a74c-4e97-9d1a-9cfe78a3194d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.343436 Jun 16 18:13:39.774672 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 387/774] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:39 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:39.775178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-043c123d-6195-4862-be69-55746df9d822 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:39.776383 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0c0c804a-8577-4cf7-abbc-efd88a2a627d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:39.778329 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-043c123d-6195-4862-be69-55746df9d822 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:39.778654 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0c0c804a-8577-4cf7-abbc-efd88a2a627d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:39.780376 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-043c123d-6195-4862-be69-55746df9d822 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:39.781888 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-043c123d-6195-4862-be69-55746df9d822 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1599 microversion: 2.20 time: 0.338965 Jun 16 18:13:39.782929 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 388/775] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:13:39 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1599 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:13:39.796406 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0c0c804a-8577-4cf7-abbc-efd88a2a627d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:39.796950 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0c0c804a-8577-4cf7-abbc-efd88a2a627d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:39.797714 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0c0c804a-8577-4cf7-abbc-efd88a2a627d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:39.798189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0c0c804a-8577-4cf7-abbc-efd88a2a627d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:39.802878 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7243b9eb-dae1-48e3-9f4f-fc94bf3af31f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:39.804562 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7243b9eb-dae1-48e3-9f4f-fc94bf3af31f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:39.811247 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7243b9eb-dae1-48e3-9f4f-fc94bf3af31f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:39.811761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7243b9eb-dae1-48e3-9f4f-fc94bf3af31f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:39.812577 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7243b9eb-dae1-48e3-9f4f-fc94bf3af31f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:39.813269 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7243b9eb-dae1-48e3-9f4f-fc94bf3af31f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:39.815022 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-0c0c804a-8577-4cf7-abbc-efd88a2a627d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] HTTP exception thrown: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0c0c804a-8577-4cf7-abbc-efd88a2a627d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Request method failure captured: Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 HTTP/1.1 Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E2tp68L59QvxZTQDN_k1jrrL-KnCDrwGAY06wn_g6GOPf6UbtY-jQnpWFNxY81e1m6uopGwB1SNq2mpyhQf4GWlaL-eshSLtE1iPGymbh5BP3-2HaI3gD8N2DfW9hc37yYr8eChINrAXPDDldjN4Yqfvpjm8j8TG9alaZxulL7KGM Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 14b0926322074e2da25ddaae611d89d4 Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:13:39.816840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:13:39.829897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14b0926322074e2da25ddaae611d89d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:13:39.829897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:13:39.829897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 14b0926322074e2da25ddaae611d89d4 Jun 16 18:13:39.829897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:13:39.829897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeTestJSON-26965284-project Jun 16 18:13:39.829897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:13:39.829897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:13:39.829897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 712089cbbf9a424fa5d4412ced2cdc58 Jun 16 18:13:39.829897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeTestJSON-26965284-project Jun 16 18:13:39.829897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:13:39.829897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:13:39.829897 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '1134706f-4520-434d-877f-bc6465b3e282'} Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:13:39.830727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:13:39.833350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:39.834620 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0c0c804a-8577-4cf7-abbc-efd88a2a627d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Returning 404 to user: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:13:39.834620 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0c0c804a-8577-4cf7-abbc-efd88a2a627d tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 404 len: 111 microversion: 2.1 time: 0.052680 Jun 16 18:13:39.834620 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 388/776] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:39 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:13:39.841847 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5db3cca5-27ed-4e8e-9be6-f78490fe6fca tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '.version_select at 0x7f9c23bebe50>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:39.926056 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7243b9eb-dae1-48e3-9f4f-fc94bf3af31f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.128974 Jun 16 18:13:39.927205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 389/777] 10.222.0.58 () {60 vars in 1315 bytes} [Thu Jun 16 18:13:39 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:13:40.002973 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5db3cca5-27ed-4e8e-9be6-f78490fe6fca tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-885876849" status: 202 len: 0 microversion: 2.1 time: 0.167464 Jun 16 18:13:40.003685 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 389/778] 10.222.0.58 () {58 vars in 1217 bytes} [Thu Jun 16 18:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-885876849 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:13:40.795317 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-dfe77333-44fa-4b72-b98f-d567deb485b9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:40.798035 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-dfe77333-44fa-4b72-b98f-d567deb485b9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:40.810404 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfe77333-44fa-4b72-b98f-d567deb485b9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:40.811634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfe77333-44fa-4b72-b98f-d567deb485b9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:40.813608 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfe77333-44fa-4b72-b98f-d567deb485b9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:40.814841 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dfe77333-44fa-4b72-b98f-d567deb485b9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:41.179963 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-dfe77333-44fa-4b72-b98f-d567deb485b9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:41.187752 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-dfe77333-44fa-4b72-b98f-d567deb485b9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.400333 Jun 16 18:13:41.188641 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 390/779] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:40 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:41.546535 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-e18f2d15-87f9-4fe0-9fc1-1436606ba6c8 req-f5de0597-0cf3-4806-91f5-bf159a6dadff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4792d5b1-2139-4dc1-b191-7975b01fc093", "tag": "7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:41.561818 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-e18f2d15-87f9-4fe0-9fc1-1436606ba6c8 req-f5de0597-0cf3-4806-91f5-bf159a6dadff service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:41.562416 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-e18f2d15-87f9-4fe0-9fc1-1436606ba6c8 req-f5de0597-0cf3-4806-91f5-bf159a6dadff service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:41.594095 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-e18f2d15-87f9-4fe0-9fc1-1436606ba6c8 req-f5de0597-0cf3-4806-91f5-bf159a6dadff service nova] Creating event network-changed:7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e for instance 4792d5b1-2139-4dc1-b191-7975b01fc093 on hv-cinder-83754 Jun 16 18:13:41.594433 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-96d8a9b9-743c-4e75-bc10-d6c800809233 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Action: 'create', calling method: .version_select at 0x7f9c3048b160>, body: {"keypair": {"name": "tempest-keypair-1769987614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeB+7z6NiRFeJkX4Q1iBGaac8vFrD5edOU6HlVqtq4wkyRnnSza2neW/dtnM6j0HjjryzxgbipiQUrWWow61Tj4OiPHT9bOp7bbqX176tXvkilcPFUpWKPawX2PHP8PVQ=="}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:41.600713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-e18f2d15-87f9-4fe0-9fc1-1436606ba6c8 req-f5de0597-0cf3-4806-91f5-bf159a6dadff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059262 Jun 16 18:13:41.601719 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 390/780] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:41.617186 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-96d8a9b9-743c-4e75-bc10-d6c800809233 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Getting quotas for project 14b0926322074e2da25ddaae611d89d4. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:13:41.622056 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-96d8a9b9-743c-4e75-bc10-d6c800809233 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Getting quotas for user 712089cbbf9a424fa5d4412ced2cdc58 and project 14b0926322074e2da25ddaae611d89d4. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:13:41.740077 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-96d8a9b9-743c-4e75-bc10-d6c800809233 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149879 Jun 16 18:13:41.741179 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 391/781] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jun 16 18:13:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:42.209751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5009630c-c6d9-4797-b09a-14416f4ae9fa tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:42.212178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5009630c-c6d9-4797-b09a-14416f4ae9fa tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:42.220254 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5009630c-c6d9-4797-b09a-14416f4ae9fa tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:42.221338 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5009630c-c6d9-4797-b09a-14416f4ae9fa tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:42.222365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5009630c-c6d9-4797-b09a-14416f4ae9fa tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:42.222986 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5009630c-c6d9-4797-b09a-14416f4ae9fa tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:42.339390 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-24f9d9b3-f796-48e4-b45a-a58a8ec8437b tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] Action: 'create', calling method: .version_select at 0x7f9c23ce7310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1325279638", "metadata": {"Type": "work"}}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:42.430797 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5009630c-c6d9-4797-b09a-14416f4ae9fa tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:42.440358 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5009630c-c6d9-4797-b09a-14416f4ae9fa tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.237455 Jun 16 18:13:42.440972 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 392/782] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:42 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:43.459879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-62c328b3-ebb1-4ac9-a90f-8e2c8c6af751 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:43.460537 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-62c328b3-ebb1-4ac9-a90f-8e2c8c6af751 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:43.466998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-62c328b3-ebb1-4ac9-a90f-8e2c8c6af751 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:43.467469 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-62c328b3-ebb1-4ac9-a90f-8e2c8c6af751 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:43.468231 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-62c328b3-ebb1-4ac9-a90f-8e2c8c6af751 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:43.468659 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-62c328b3-ebb1-4ac9-a90f-8e2c8c6af751 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:43.636807 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-62c328b3-ebb1-4ac9-a90f-8e2c8c6af751 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:43.650227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-62c328b3-ebb1-4ac9-a90f-8e2c8c6af751 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.195290 Jun 16 18:13:43.651170 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 393/783] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:43 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:43.656578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-24f9d9b3-f796-48e4-b45a-a58a8ec8437b tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.503174 Jun 16 18:13:43.657204 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 391/784] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Jun 16 18:13:42 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1505 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 18:13:43.669649 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2639f7f6-bb76-455e-aceb-0ccf5139bc00 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] Calling method '.version_select at 0x7f9c304788b0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:43.721705 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2639f7f6-bb76-455e-aceb-0ccf5139bc00 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407" status: 200 len: 353 microversion: 2.1 time: 0.056300 Jun 16 18:13:43.722629 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 394/785] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:13:43 2022] GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:44.671055 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a8ae2ecc-e506-41bf-8441-cd1b12c9fafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:44.676989 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a8ae2ecc-e506-41bf-8441-cd1b12c9fafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:44.679326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a8ae2ecc-e506-41bf-8441-cd1b12c9fafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:44.680004 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a8ae2ecc-e506-41bf-8441-cd1b12c9fafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:44.680600 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a8ae2ecc-e506-41bf-8441-cd1b12c9fafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:44.681038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a8ae2ecc-e506-41bf-8441-cd1b12c9fafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:44.735086 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-635445e7-eb49-41fc-8eab-bef458615a6d tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] Calling method '.version_select at 0x7f9c304c3dc0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:44.814588 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-635445e7-eb49-41fc-8eab-bef458615a6d tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407" status: 200 len: 353 microversion: 2.1 time: 0.070011 Jun 16 18:13:44.814588 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 395/786] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:13:44 2022] GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407 => generated 353 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:44.850634 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a8ae2ecc-e506-41bf-8441-cd1b12c9fafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:44.858259 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a8ae2ecc-e506-41bf-8441-cd1b12c9fafb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.191823 Jun 16 18:13:44.858821 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 392/787] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:44 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:45.816365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-24620275-dbeb-4b3f-af6a-8239c04dff1f tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] Calling method '.version_select at 0x7f9c303994c0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:45.868432 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-24620275-dbeb-4b3f-af6a-8239c04dff1f tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407" status: 200 len: 354 microversion: 2.1 time: 0.056783 Jun 16 18:13:45.869035 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 396/788] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:13:45 2022] GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:13:45.876235 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-de0d7384-26b2-47bf-83e3-a92a63e46bbb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:45.877190 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-de0d7384-26b2-47bf-83e3-a92a63e46bbb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:45.886046 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-584d4feb-dfc2-4ef1-b9b0-edac02f0f534 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] Calling method '.version_select at 0x7f9c304c3a60>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:45.887248 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-de0d7384-26b2-47bf-83e3-a92a63e46bbb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:45.887755 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-de0d7384-26b2-47bf-83e3-a92a63e46bbb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:45.888895 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-de0d7384-26b2-47bf-83e3-a92a63e46bbb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:45.889487 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-de0d7384-26b2-47bf-83e3-a92a63e46bbb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:45.960745 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-584d4feb-dfc2-4ef1-b9b0-edac02f0f534 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407" status: 200 len: 354 microversion: 2.1 time: 0.079832 Jun 16 18:13:45.961599 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 397/789] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:13:45 2022] GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407 => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:13:45.967850 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1595177278", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb31acf5-629a-4efc-bb11-e4f0dbd882be"}], "security_groups": [{"name": "tempest-securitygroup--519616249"}], "key_name": "tempest-keypair-1769987614", "user_data": "}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:46.070021 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-de0d7384-26b2-47bf-83e3-a92a63e46bbb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:46.082339 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-de0d7384-26b2-47bf-83e3-a92a63e46bbb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.209739 Jun 16 18:13:46.083000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 393/790] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:45 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:46.088377 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-73f32cf7-775d-4079-a67c-08c25c0dd691 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] Calling method '.version_select at 0x7f9c23cc8280>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:46.106634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] validate_networks() for [('bb31acf5-629a-4efc-bb11-e4f0dbd882be', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:13:46.517697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:13:46.518340 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:13:46.518905 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:13:46.519736 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:13:46.520477 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:13:46.530159 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:46.530633 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:46.531457 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:46.531885 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:46.548532 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Getting quotas for project 14b0926322074e2da25ddaae611d89d4. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:13:46.553090 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Getting quotas for user 712089cbbf9a424fa5d4412ced2cdc58 and project 14b0926322074e2da25ddaae611d89d4. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:13:46.562839 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-73f32cf7-775d-4079-a67c-08c25c0dd691 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407" status: 202 len: 0 microversion: 2.1 time: 0.478590 Jun 16 18:13:46.563804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 394/791] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jun 16 18:13:46 2022] DELETE /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:13:46.565888 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:13:46.569535 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:13:46.572291 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-28f76f98-9790-4134-b251-0fdaf2f85953 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] Calling method '.version_select at 0x7f9c23b5a160>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:46.621489 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-28f76f98-9790-4134-b251-0fdaf2f85953 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407" status: 200 len: 353 microversion: 2.1 time: 0.052704 Jun 16 18:13:46.622052 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 395/792] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:13:46 2022] GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:13:46.655168 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:46.862058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5a832773-0304-4571-a992-960f86d0b8c4 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.899313 Jun 16 18:13:46.862775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 398/793] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:13:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:13:46.875042 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-83ed3ef9-e7a8-4139-b888-392930480613 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:46.875786 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-83ed3ef9-e7a8-4139-b888-392930480613 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:46.878059 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:46.949558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-83ed3ef9-e7a8-4139-b888-392930480613 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:46.958148 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-83ed3ef9-e7a8-4139-b888-392930480613 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1238 microversion: 2.1 time: 0.086829 Jun 16 18:13:46.959342 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 396/794] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:46 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:47.100216 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-cac3dbe5-8cff-47af-93ed-7b07d1149330 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:47.100912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-cac3dbe5-8cff-47af-93ed-7b07d1149330 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:47.107541 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cac3dbe5-8cff-47af-93ed-7b07d1149330 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:47.107985 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cac3dbe5-8cff-47af-93ed-7b07d1149330 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:47.108860 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cac3dbe5-8cff-47af-93ed-7b07d1149330 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:47.109290 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cac3dbe5-8cff-47af-93ed-7b07d1149330 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:47.257993 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-cac3dbe5-8cff-47af-93ed-7b07d1149330 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:47.265613 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-cac3dbe5-8cff-47af-93ed-7b07d1149330 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.169399 Jun 16 18:13:47.266182 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 399/795] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:47 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:47.638444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-814e54de-769a-471f-aaaa-8637ade7ddb5 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] Calling method '.version_select at 0x7f9c23c46820>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:47.682281 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-814e54de-769a-471f-aaaa-8637ade7ddb5 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] HTTP exception thrown: Volume b0e06615-655d-4ab4-bf3f-ac1f61fc3407 could not be found. Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-814e54de-769a-471f-aaaa-8637ade7ddb5 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] Request method failure captured: Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407 HTTP/1.1 Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3LWZ0Ob9sqwJbOPo82TOOH2QfYuiJlVCvHXnqwnRvwvGKdIXRycOkxaxRPcEBhGKVQfOBU1ylpAvjKbiTZ9ETHYIF_22cdS1u5WvQ-DIWOimZw_p1HATkp0H7IKkoK36LIQ4RmD_j9R_hl8MLn-fezMoqXxWJXIw9xTdYxXbpJ1rIs Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 37dc0134db3d4e52ac4d8d6c16e3f329 Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-VolumesGetTestJSON-1511722149 Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:13:47.684588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_37dc0134db3d4e52ac4d8d6c16e3f329"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37dc0134db3d4e52ac4d8d6c16e3f329"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/37dc0134db3d4e52ac4d8d6c16e3f329"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/37dc0134db3d4e52ac4d8d6c16e3f329"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-VolumesGetTestJSON-1511722149 Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 37dc0134db3d4e52ac4d8d6c16e3f329 Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-VolumesGetTestJSON-1511722149 Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-VolumesGetTestJSON-1511722149-project Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 6b03fe85ce744b38b1ed4d47fabc46ec Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-VolumesGetTestJSON-1511722149-project Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Volume b0e06615-655d-4ab4-bf3f-ac1f61fc3407 could not be found. Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': 'b0e06615-655d-4ab4-bf3f-ac1f61fc3407'} Jun 16 18:13:47.686008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0e06615-655d-4ab4-bf3f-ac1f61fc3407 could not be found. (HTTP 404) (Request-ID: req-5cd13def-0b7c-400b-a669-20836248c5d0) Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:47.686914 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:13:47.688798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0e06615-655d-4ab4-bf3f-ac1f61fc3407 could not be found. Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:13:47.691075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0e06615-655d-4ab4-bf3f-ac1f61fc3407 could not be found. Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0e06615-655d-4ab4-bf3f-ac1f61fc3407 could not be found. Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-814e54de-769a-471f-aaaa-8637ade7ddb5 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] Returning 404 to user: Volume b0e06615-655d-4ab4-bf3f-ac1f61fc3407 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:13:47.693728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-814e54de-769a-471f-aaaa-8637ade7ddb5 tempest-VolumesGetTestJSON-1511722149 tempest-VolumesGetTestJSON-1511722149-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407" status: 404 len: 109 microversion: 2.1 time: 0.054772 Jun 16 18:13:47.695578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 397/796] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:13:47 2022] GET /compute/v2.1/os-volumes/b0e06615-655d-4ab4-bf3f-ac1f61fc3407 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:13:47.983099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-85cdebd3-db12-4705-b882-f7269abdb4f9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:47.983099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-85cdebd3-db12-4705-b882-f7269abdb4f9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:48.039890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-85cdebd3-db12-4705-b882-f7269abdb4f9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:48.046805 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-85cdebd3-db12-4705-b882-f7269abdb4f9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1238 microversion: 2.1 time: 0.074280 Jun 16 18:13:48.047390 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 400/797] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:47 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:48.283639 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-904ec604-49a3-4c13-aec6-6e8645a82a7a tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:48.284246 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-904ec604-49a3-4c13-aec6-6e8645a82a7a tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:48.291950 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-904ec604-49a3-4c13-aec6-6e8645a82a7a tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:48.292397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-904ec604-49a3-4c13-aec6-6e8645a82a7a tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:48.293182 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-904ec604-49a3-4c13-aec6-6e8645a82a7a tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:48.293707 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-904ec604-49a3-4c13-aec6-6e8645a82a7a tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:48.715344 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-904ec604-49a3-4c13-aec6-6e8645a82a7a tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:48.722859 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-904ec604-49a3-4c13-aec6-6e8645a82a7a tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.443516 Jun 16 18:13:48.723468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 398/798] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:48 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:49.069240 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a75d56cf-cb14-4ec9-9dcd-f1c3a03180bf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:49.069788 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a75d56cf-cb14-4ec9-9dcd-f1c3a03180bf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:49.076842 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a75d56cf-cb14-4ec9-9dcd-f1c3a03180bf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:49.077280 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a75d56cf-cb14-4ec9-9dcd-f1c3a03180bf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:49.078079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a75d56cf-cb14-4ec9-9dcd-f1c3a03180bf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:49.078507 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a75d56cf-cb14-4ec9-9dcd-f1c3a03180bf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:49.149993 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a75d56cf-cb14-4ec9-9dcd-f1c3a03180bf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:49.157609 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a75d56cf-cb14-4ec9-9dcd-f1c3a03180bf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1242 microversion: 2.1 time: 0.092768 Jun 16 18:13:49.158174 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 401/799] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:49 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:49.741255 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c21cdfd2-38a2-4d26-856f-440ca1278264 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:49.741927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c21cdfd2-38a2-4d26-856f-440ca1278264 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:49.748966 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c21cdfd2-38a2-4d26-856f-440ca1278264 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:49.749465 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c21cdfd2-38a2-4d26-856f-440ca1278264 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:49.751315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c21cdfd2-38a2-4d26-856f-440ca1278264 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:49.751315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c21cdfd2-38a2-4d26-856f-440ca1278264 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:49.905065 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c21cdfd2-38a2-4d26-856f-440ca1278264 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:49.918590 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c21cdfd2-38a2-4d26-856f-440ca1278264 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.181698 Jun 16 18:13:49.920088 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 399/800] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:49 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:50.174630 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2577590a-02da-4353-b572-d5abbcc0a658 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:50.175227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2577590a-02da-4353-b572-d5abbcc0a658 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:50.183385 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2577590a-02da-4353-b572-d5abbcc0a658 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:50.183385 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2577590a-02da-4353-b572-d5abbcc0a658 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:50.186800 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2577590a-02da-4353-b572-d5abbcc0a658 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:50.186800 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2577590a-02da-4353-b572-d5abbcc0a658 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:50.249622 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2577590a-02da-4353-b572-d5abbcc0a658 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:50.261253 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2577590a-02da-4353-b572-d5abbcc0a658 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1290 microversion: 2.1 time: 0.089657 Jun 16 18:13:50.261857 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 402/801] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:50 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:50.938424 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5b3c9925-4bee-4418-8443-db4a4e798de5 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:50.939518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5b3c9925-4bee-4418-8443-db4a4e798de5 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:50.947716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5b3c9925-4bee-4418-8443-db4a4e798de5 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:50.948162 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5b3c9925-4bee-4418-8443-db4a4e798de5 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:50.948935 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5b3c9925-4bee-4418-8443-db4a4e798de5 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:50.949361 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5b3c9925-4bee-4418-8443-db4a4e798de5 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:51.134397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5b3c9925-4bee-4418-8443-db4a4e798de5 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:51.137974 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:51.149887 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5b3c9925-4bee-4418-8443-db4a4e798de5 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.216167 Jun 16 18:13:51.150477 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 400/802] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:50 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:51.278752 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7a444046-0d13-4a38-ba3d-49ea4c1da084 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:51.280158 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7a444046-0d13-4a38-ba3d-49ea4c1da084 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:51.287800 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7a444046-0d13-4a38-ba3d-49ea4c1da084 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:51.288478 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7a444046-0d13-4a38-ba3d-49ea4c1da084 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:51.289262 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7a444046-0d13-4a38-ba3d-49ea4c1da084 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:51.289874 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7a444046-0d13-4a38-ba3d-49ea4c1da084 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:51.365758 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7a444046-0d13-4a38-ba3d-49ea4c1da084 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:51.383611 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7a444046-0d13-4a38-ba3d-49ea4c1da084 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1298 microversion: 2.1 time: 0.107558 Jun 16 18:13:51.383611 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 403/803] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:51 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1298 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:52.166191 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-721ed1e9-955a-43ae-a16e-df0097a32848 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:52.166802 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-721ed1e9-955a-43ae-a16e-df0097a32848 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:52.174387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-721ed1e9-955a-43ae-a16e-df0097a32848 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:52.174832 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-721ed1e9-955a-43ae-a16e-df0097a32848 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:52.175708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-721ed1e9-955a-43ae-a16e-df0097a32848 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:52.176127 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-721ed1e9-955a-43ae-a16e-df0097a32848 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:52.392108 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-721ed1e9-955a-43ae-a16e-df0097a32848 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:52.401432 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-721ed1e9-955a-43ae-a16e-df0097a32848 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1569 microversion: 2.1 time: 0.239048 Jun 16 18:13:52.401879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7fb90c6f-6fcd-423f-b658-1b07294fa768 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:52.402593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7fb90c6f-6fcd-423f-b658-1b07294fa768 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:52.410462 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7fb90c6f-6fcd-423f-b658-1b07294fa768 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:52.411761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7fb90c6f-6fcd-423f-b658-1b07294fa768 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:52.412959 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7fb90c6f-6fcd-423f-b658-1b07294fa768 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:52.413702 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7fb90c6f-6fcd-423f-b658-1b07294fa768 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:52.415101 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 401/804] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:52 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:52.423288 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0496bd5a-267c-4ce8-bd85-fe5aaf0af723 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:52.423896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0496bd5a-267c-4ce8-bd85-fe5aaf0af723 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:52.431831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0496bd5a-267c-4ce8-bd85-fe5aaf0af723 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:52.432468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0496bd5a-267c-4ce8-bd85-fe5aaf0af723 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:52.433259 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0496bd5a-267c-4ce8-bd85-fe5aaf0af723 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:52.433691 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0496bd5a-267c-4ce8-bd85-fe5aaf0af723 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:52.713028 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7fb90c6f-6fcd-423f-b658-1b07294fa768 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:52.729340 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7fb90c6f-6fcd-423f-b658-1b07294fa768 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.332134 Jun 16 18:13:52.730003 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 404/805] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:52 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:52.833643 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0496bd5a-267c-4ce8-bd85-fe5aaf0af723 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "POST /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79/action" status: 202 len: 0 microversion: 2.1 time: 0.415457 Jun 16 18:13:52.834477 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 402/806] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:13:52 2022] POST /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:13:52.844969 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0294b37e-440b-4ed2-8fc8-4bc7b92f62c9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:52.845607 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0294b37e-440b-4ed2-8fc8-4bc7b92f62c9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:52.853408 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0294b37e-440b-4ed2-8fc8-4bc7b92f62c9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:52.853865 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0294b37e-440b-4ed2-8fc8-4bc7b92f62c9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:52.854910 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0294b37e-440b-4ed2-8fc8-4bc7b92f62c9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:52.855355 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0294b37e-440b-4ed2-8fc8-4bc7b92f62c9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:53.045555 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0294b37e-440b-4ed2-8fc8-4bc7b92f62c9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:53.056005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0294b37e-440b-4ed2-8fc8-4bc7b92f62c9 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1517 microversion: 2.1 time: 0.214844 Jun 16 18:13:53.057374 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 405/807] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:52 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1517 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:53.266972 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-50f46850-6217-4f3d-a8a9-7b8da575a653 req-41f34e97-8d71-4cf3-9491-0801a25bbd53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6c9426-2d6f-4dfb-8bc8-959827d8cf79", "name": "network-vif-unplugged", "status": "completed", "tag": "aaf3fae1-693c-4fec-8e06-dc30896dc3f7"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:53.299733 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-50f46850-6217-4f3d-a8a9-7b8da575a653 req-41f34e97-8d71-4cf3-9491-0801a25bbd53 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:53.300630 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-50f46850-6217-4f3d-a8a9-7b8da575a653 req-41f34e97-8d71-4cf3-9491-0801a25bbd53 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:53.330803 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.compute.server_external_events [req-50f46850-6217-4f3d-a8a9-7b8da575a653 req-41f34e97-8d71-4cf3-9491-0801a25bbd53 service nova] Unable to find a host for instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79. Dropping event network-vif-unplugged {{(pid=118162) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 18:13:53.332355 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-50f46850-6217-4f3d-a8a9-7b8da575a653 req-41f34e97-8d71-4cf3-9491-0801a25bbd53 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.070956 Jun 16 18:13:53.333591 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 403/808] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 73 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 18:13:53.664507 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-dbddb219-ec28-4d4d-8f1a-5713036ef7ea req-c66428ad-76d4-4f76-bb7a-f0df62cba5db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ceb78ff-a348-4800-9bec-517f2cccc8c3", "tag": "62c371e1-4b97-4c82-8910-07da309b05e0"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:13:53.732435 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-dbddb219-ec28-4d4d-8f1a-5713036ef7ea req-c66428ad-76d4-4f76-bb7a-f0df62cba5db service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:53.732435 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-dbddb219-ec28-4d4d-8f1a-5713036ef7ea req-c66428ad-76d4-4f76-bb7a-f0df62cba5db service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:53.732435 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-dbddb219-ec28-4d4d-8f1a-5713036ef7ea req-c66428ad-76d4-4f76-bb7a-f0df62cba5db service nova] Creating event network-changed:62c371e1-4b97-4c82-8910-07da309b05e0 for instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 on hv-cinder-83754 Jun 16 18:13:53.732435 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-dbddb219-ec28-4d4d-8f1a-5713036ef7ea req-c66428ad-76d4-4f76-bb7a-f0df62cba5db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061179 Jun 16 18:13:53.732435 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 406/809] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:13:53.761013 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9b95b7a9-35d3-4deb-a669-fe7f797b46fd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:53.761983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9b95b7a9-35d3-4deb-a669-fe7f797b46fd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:53.768738 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9b95b7a9-35d3-4deb-a669-fe7f797b46fd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:53.769188 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9b95b7a9-35d3-4deb-a669-fe7f797b46fd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:53.769951 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9b95b7a9-35d3-4deb-a669-fe7f797b46fd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:53.770433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9b95b7a9-35d3-4deb-a669-fe7f797b46fd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:54.002759 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9b95b7a9-35d3-4deb-a669-fe7f797b46fd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:54.012273 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9b95b7a9-35d3-4deb-a669-fe7f797b46fd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.255000 Jun 16 18:13:54.012873 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 404/810] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:53 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:54.081954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-67b565d5-e429-4cff-89bb-50c96ef5a10b tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:54.083285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-67b565d5-e429-4cff-89bb-50c96ef5a10b tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:54.090935 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-67b565d5-e429-4cff-89bb-50c96ef5a10b tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:54.091413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-67b565d5-e429-4cff-89bb-50c96ef5a10b tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:54.092264 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-67b565d5-e429-4cff-89bb-50c96ef5a10b tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:54.092703 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-67b565d5-e429-4cff-89bb-50c96ef5a10b tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:54.118157 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:54.312434 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-67b565d5-e429-4cff-89bb-50c96ef5a10b tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:54.325828 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-67b565d5-e429-4cff-89bb-50c96ef5a10b tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1517 microversion: 2.1 time: 0.248345 Jun 16 18:13:54.326525 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 407/811] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:54 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:55.030562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ddc83bcf-7495-4518-a4ee-8a78b0e4f000 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:55.031691 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ddc83bcf-7495-4518-a4ee-8a78b0e4f000 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:55.040455 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ddc83bcf-7495-4518-a4ee-8a78b0e4f000 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:55.040905 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ddc83bcf-7495-4518-a4ee-8a78b0e4f000 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:55.041704 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ddc83bcf-7495-4518-a4ee-8a78b0e4f000 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:55.042143 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ddc83bcf-7495-4518-a4ee-8a78b0e4f000 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:55.186886 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ddc83bcf-7495-4518-a4ee-8a78b0e4f000 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:55.196201 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ddc83bcf-7495-4518-a4ee-8a78b0e4f000 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.170495 Jun 16 18:13:55.196777 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 405/812] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:55 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:55.344074 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0a5c516b-1148-4aef-a80d-5b2ad4d0616f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:55.344658 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0a5c516b-1148-4aef-a80d-5b2ad4d0616f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:55.352525 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0a5c516b-1148-4aef-a80d-5b2ad4d0616f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:55.353026 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0a5c516b-1148-4aef-a80d-5b2ad4d0616f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:55.353890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0a5c516b-1148-4aef-a80d-5b2ad4d0616f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:55.354323 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0a5c516b-1148-4aef-a80d-5b2ad4d0616f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:55.515756 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0a5c516b-1148-4aef-a80d-5b2ad4d0616f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:55.524046 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0a5c516b-1148-4aef-a80d-5b2ad4d0616f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1519 microversion: 2.1 time: 0.183758 Jun 16 18:13:55.535143 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 408/813] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:55 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:56.213887 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-65b5bd9f-a801-4f51-bb98-75b0e4e1400e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:56.214525 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-65b5bd9f-a801-4f51-bb98-75b0e4e1400e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:56.221153 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-65b5bd9f-a801-4f51-bb98-75b0e4e1400e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:56.221597 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-65b5bd9f-a801-4f51-bb98-75b0e4e1400e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:56.222407 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-65b5bd9f-a801-4f51-bb98-75b0e4e1400e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:56.222831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-65b5bd9f-a801-4f51-bb98-75b0e4e1400e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:56.362515 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-65b5bd9f-a801-4f51-bb98-75b0e4e1400e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:56.370880 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-65b5bd9f-a801-4f51-bb98-75b0e4e1400e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.160767 Jun 16 18:13:56.371489 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 406/814] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:56 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:56.543080 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2e24606f-5b09-4f70-9c28-65de1ed5a498 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:56.543733 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2e24606f-5b09-4f70-9c28-65de1ed5a498 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:56.546284 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:56.551843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e24606f-5b09-4f70-9c28-65de1ed5a498 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:56.552304 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e24606f-5b09-4f70-9c28-65de1ed5a498 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:56.553079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e24606f-5b09-4f70-9c28-65de1ed5a498 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:56.553507 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e24606f-5b09-4f70-9c28-65de1ed5a498 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:56.725777 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2e24606f-5b09-4f70-9c28-65de1ed5a498 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:56.736886 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2e24606f-5b09-4f70-9c28-65de1ed5a498 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1519 microversion: 2.1 time: 0.197990 Jun 16 18:13:56.737474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 409/815] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:56 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:57.389212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b2bdb405-09cb-49df-9eea-fe022b7d8f46 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:57.389901 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b2bdb405-09cb-49df-9eea-fe022b7d8f46 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:57.392027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:57.398607 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b2bdb405-09cb-49df-9eea-fe022b7d8f46 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:57.399269 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b2bdb405-09cb-49df-9eea-fe022b7d8f46 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:57.400228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b2bdb405-09cb-49df-9eea-fe022b7d8f46 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:57.400664 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b2bdb405-09cb-49df-9eea-fe022b7d8f46 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:57.560089 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b2bdb405-09cb-49df-9eea-fe022b7d8f46 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:57.571722 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b2bdb405-09cb-49df-9eea-fe022b7d8f46 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.187201 Jun 16 18:13:57.572740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 407/816] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:57 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:57.756447 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8f00c284-9701-49dd-82a0-cef5f2486e38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:57.758920 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8f00c284-9701-49dd-82a0-cef5f2486e38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:57.765268 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8f00c284-9701-49dd-82a0-cef5f2486e38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:57.765719 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8f00c284-9701-49dd-82a0-cef5f2486e38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:57.766491 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8f00c284-9701-49dd-82a0-cef5f2486e38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:57.766923 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8f00c284-9701-49dd-82a0-cef5f2486e38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:57.947408 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8f00c284-9701-49dd-82a0-cef5f2486e38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:57.956248 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8f00c284-9701-49dd-82a0-cef5f2486e38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1519 microversion: 2.1 time: 0.203784 Jun 16 18:13:57.956830 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 410/817] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:57 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:13:58.592092 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-98f3abeb-a52e-43ed-86a8-38a3919a63bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:58.592874 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-98f3abeb-a52e-43ed-86a8-38a3919a63bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:58.601248 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-98f3abeb-a52e-43ed-86a8-38a3919a63bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:58.601940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-98f3abeb-a52e-43ed-86a8-38a3919a63bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:58.602869 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-98f3abeb-a52e-43ed-86a8-38a3919a63bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:58.603569 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-98f3abeb-a52e-43ed-86a8-38a3919a63bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:58.864683 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-98f3abeb-a52e-43ed-86a8-38a3919a63bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:58.872800 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-98f3abeb-a52e-43ed-86a8-38a3919a63bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.286035 Jun 16 18:13:58.873462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 408/818] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:58 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:58.977563 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2471002a-99b0-402e-a96e-32d2fc648596 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:58.978497 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2471002a-99b0-402e-a96e-32d2fc648596 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:58.980590 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=12 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:13:58.986357 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2471002a-99b0-402e-a96e-32d2fc648596 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:58.987005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2471002a-99b0-402e-a96e-32d2fc648596 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:58.987799 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2471002a-99b0-402e-a96e-32d2fc648596 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:58.988226 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2471002a-99b0-402e-a96e-32d2fc648596 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:59.148175 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2471002a-99b0-402e-a96e-32d2fc648596 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:13:59.155846 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2471002a-99b0-402e-a96e-32d2fc648596 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.183093 Jun 16 18:13:59.156437 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 411/819] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:58 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:13:59.891650 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d83a228b-024d-4b36-968c-f807dbddf636 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:13:59.892281 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d83a228b-024d-4b36-968c-f807dbddf636 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:13:59.899889 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d83a228b-024d-4b36-968c-f807dbddf636 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:59.900346 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d83a228b-024d-4b36-968c-f807dbddf636 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:13:59.901124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d83a228b-024d-4b36-968c-f807dbddf636 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:13:59.901607 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d83a228b-024d-4b36-968c-f807dbddf636 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:00.034725 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d83a228b-024d-4b36-968c-f807dbddf636 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:00.042970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d83a228b-024d-4b36-968c-f807dbddf636 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.155275 Jun 16 18:14:00.043617 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 409/820] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:13:59 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:00.173247 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-07f26d9f-4458-4516-b742-95546ccd4cac tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:00.173839 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-07f26d9f-4458-4516-b742-95546ccd4cac tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:00.181211 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07f26d9f-4458-4516-b742-95546ccd4cac tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:00.181650 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07f26d9f-4458-4516-b742-95546ccd4cac tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:00.182399 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07f26d9f-4458-4516-b742-95546ccd4cac tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:00.182824 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-07f26d9f-4458-4516-b742-95546ccd4cac tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:00.324261 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-07f26d9f-4458-4516-b742-95546ccd4cac tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:00.331757 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-07f26d9f-4458-4516-b742-95546ccd4cac tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.162702 Jun 16 18:14:00.332321 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 412/821] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:00 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:01.060796 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e94984a8-6110-4f17-9c17-f326504e1b32 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:01.061358 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e94984a8-6110-4f17-9c17-f326504e1b32 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:01.069136 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e94984a8-6110-4f17-9c17-f326504e1b32 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:01.069662 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e94984a8-6110-4f17-9c17-f326504e1b32 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:01.070424 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e94984a8-6110-4f17-9c17-f326504e1b32 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:01.070852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e94984a8-6110-4f17-9c17-f326504e1b32 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:01.206502 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e94984a8-6110-4f17-9c17-f326504e1b32 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:01.215124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e94984a8-6110-4f17-9c17-f326504e1b32 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.158238 Jun 16 18:14:01.215734 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 410/822] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:01 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:14:01.349238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-71dc152f-163a-4f9e-a360-488f8ca486a6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:01.349792 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-71dc152f-163a-4f9e-a360-488f8ca486a6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:01.356357 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-71dc152f-163a-4f9e-a360-488f8ca486a6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:01.356808 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-71dc152f-163a-4f9e-a360-488f8ca486a6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:01.357571 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-71dc152f-163a-4f9e-a360-488f8ca486a6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:01.358005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-71dc152f-163a-4f9e-a360-488f8ca486a6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:01.529142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-71dc152f-163a-4f9e-a360-488f8ca486a6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:01.537125 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-71dc152f-163a-4f9e-a360-488f8ca486a6 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.191960 Jun 16 18:14:01.537702 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 413/823] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:01 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:02.231391 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2e66952e-e510-49db-81b1-0a545efbab61 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:02.232044 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2e66952e-e510-49db-81b1-0a545efbab61 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:02.238621 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2e66952e-e510-49db-81b1-0a545efbab61 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:02.239075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2e66952e-e510-49db-81b1-0a545efbab61 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:02.239872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2e66952e-e510-49db-81b1-0a545efbab61 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:02.240311 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2e66952e-e510-49db-81b1-0a545efbab61 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:02.383588 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2e66952e-e510-49db-81b1-0a545efbab61 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:02.391082 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2e66952e-e510-49db-81b1-0a545efbab61 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.163575 Jun 16 18:14:02.391686 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 411/824] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:02 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:02.554279 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9cc5ca63-a3b5-417f-af10-89d37b4aaf7c tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:02.554887 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9cc5ca63-a3b5-417f-af10-89d37b4aaf7c tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:02.561772 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9cc5ca63-a3b5-417f-af10-89d37b4aaf7c tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:02.562220 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9cc5ca63-a3b5-417f-af10-89d37b4aaf7c tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:02.562986 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9cc5ca63-a3b5-417f-af10-89d37b4aaf7c tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:02.563453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9cc5ca63-a3b5-417f-af10-89d37b4aaf7c tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:02.705942 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9cc5ca63-a3b5-417f-af10-89d37b4aaf7c tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:02.714318 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9cc5ca63-a3b5-417f-af10-89d37b4aaf7c tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.164079 Jun 16 18:14:02.714935 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 414/825] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:02 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:03.413145 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ea4b4205-57b6-4a01-b03c-10bf48e01193 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:03.413723 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ea4b4205-57b6-4a01-b03c-10bf48e01193 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:03.420429 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ea4b4205-57b6-4a01-b03c-10bf48e01193 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:03.420872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ea4b4205-57b6-4a01-b03c-10bf48e01193 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:03.421637 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ea4b4205-57b6-4a01-b03c-10bf48e01193 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:03.422110 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ea4b4205-57b6-4a01-b03c-10bf48e01193 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:03.569924 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ea4b4205-57b6-4a01-b03c-10bf48e01193 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:03.577526 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ea4b4205-57b6-4a01-b03c-10bf48e01193 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.171765 Jun 16 18:14:03.578086 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 412/826] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:03 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:03.731586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-70f32fcc-7283-48c1-96f3-0d2a766b5263 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:03.732221 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-70f32fcc-7283-48c1-96f3-0d2a766b5263 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:03.738798 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-70f32fcc-7283-48c1-96f3-0d2a766b5263 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:03.739279 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-70f32fcc-7283-48c1-96f3-0d2a766b5263 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:03.740632 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-70f32fcc-7283-48c1-96f3-0d2a766b5263 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:03.741068 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-70f32fcc-7283-48c1-96f3-0d2a766b5263 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:03.876689 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-70f32fcc-7283-48c1-96f3-0d2a766b5263 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:03.885301 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-70f32fcc-7283-48c1-96f3-0d2a766b5263 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.157641 Jun 16 18:14:03.885875 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 415/827] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:03 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:04.595259 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9dc3cd8f-6a1c-4765-afe3-a0a1f6d1b9bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:04.596304 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9dc3cd8f-6a1c-4765-afe3-a0a1f6d1b9bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:04.603670 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9dc3cd8f-6a1c-4765-afe3-a0a1f6d1b9bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:04.604143 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9dc3cd8f-6a1c-4765-afe3-a0a1f6d1b9bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:04.605122 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9dc3cd8f-6a1c-4765-afe3-a0a1f6d1b9bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:04.605678 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9dc3cd8f-6a1c-4765-afe3-a0a1f6d1b9bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:04.752814 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9dc3cd8f-6a1c-4765-afe3-a0a1f6d1b9bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:04.761340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9dc3cd8f-6a1c-4765-afe3-a0a1f6d1b9bd tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.169878 Jun 16 18:14:04.765798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 413/828] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:04 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:04.903668 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1139def4-7cbc-46a0-9bfc-80f15d9b9f16 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:04.904884 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1139def4-7cbc-46a0-9bfc-80f15d9b9f16 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:04.911139 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1139def4-7cbc-46a0-9bfc-80f15d9b9f16 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:04.912264 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1139def4-7cbc-46a0-9bfc-80f15d9b9f16 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:04.913526 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1139def4-7cbc-46a0-9bfc-80f15d9b9f16 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:04.913956 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1139def4-7cbc-46a0-9bfc-80f15d9b9f16 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:05.077083 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1139def4-7cbc-46a0-9bfc-80f15d9b9f16 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:05.085223 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1139def4-7cbc-46a0-9bfc-80f15d9b9f16 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.185442 Jun 16 18:14:05.085829 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 416/829] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:04 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:05.313839 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-e8ceddf0-687a-418e-a3f1-7cdb4734ae6b req-b33a4e51-8430-4a16-9d3e-9bc94cc1a1d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceb78ff-a348-4800-9bec-517f2cccc8c3", "name": "network-vif-plugged", "status": "completed", "tag": "62c371e1-4b97-4c82-8910-07da309b05e0"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:14:05.324414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-e8ceddf0-687a-418e-a3f1-7cdb4734ae6b req-b33a4e51-8430-4a16-9d3e-9bc94cc1a1d9 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:05.324860 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-e8ceddf0-687a-418e-a3f1-7cdb4734ae6b req-b33a4e51-8430-4a16-9d3e-9bc94cc1a1d9 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:05.339596 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-e8ceddf0-687a-418e-a3f1-7cdb4734ae6b req-b33a4e51-8430-4a16-9d3e-9bc94cc1a1d9 service nova] Creating event network-vif-plugged:62c371e1-4b97-4c82-8910-07da309b05e0 for instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 on hv-cinder-83754 Jun 16 18:14:05.344727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-e8ceddf0-687a-418e-a3f1-7cdb4734ae6b req-b33a4e51-8430-4a16-9d3e-9bc94cc1a1d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035280 Jun 16 18:14:05.345651 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 414/830] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:14:05.778819 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d5b825bc-5820-448c-8f96-67abb84cdb06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:05.779390 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d5b825bc-5820-448c-8f96-67abb84cdb06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:05.785528 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d5b825bc-5820-448c-8f96-67abb84cdb06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:05.785975 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d5b825bc-5820-448c-8f96-67abb84cdb06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:05.786867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d5b825bc-5820-448c-8f96-67abb84cdb06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:05.787416 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d5b825bc-5820-448c-8f96-67abb84cdb06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:05.983056 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d5b825bc-5820-448c-8f96-67abb84cdb06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:05.993229 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d5b825bc-5820-448c-8f96-67abb84cdb06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.217672 Jun 16 18:14:05.993229 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 417/831] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:05 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:06.104578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-05334ff2-4ea5-412f-854f-4ae187e79ce4 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:06.105275 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-05334ff2-4ea5-412f-854f-4ae187e79ce4 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:06.112109 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-05334ff2-4ea5-412f-854f-4ae187e79ce4 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:06.112577 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-05334ff2-4ea5-412f-854f-4ae187e79ce4 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:06.113349 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-05334ff2-4ea5-412f-854f-4ae187e79ce4 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:06.113825 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-05334ff2-4ea5-412f-854f-4ae187e79ce4 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:06.280192 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-05334ff2-4ea5-412f-854f-4ae187e79ce4 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:06.291510 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-05334ff2-4ea5-412f-854f-4ae187e79ce4 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.191974 Jun 16 18:14:06.292002 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 415/832] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:06 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:07.011225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ee8127dc-2ecc-47cb-8108-5646f782e17a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:07.011986 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ee8127dc-2ecc-47cb-8108-5646f782e17a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:07.019620 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ee8127dc-2ecc-47cb-8108-5646f782e17a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:07.020081 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ee8127dc-2ecc-47cb-8108-5646f782e17a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:07.020955 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ee8127dc-2ecc-47cb-8108-5646f782e17a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:07.021991 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ee8127dc-2ecc-47cb-8108-5646f782e17a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:07.171720 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ee8127dc-2ecc-47cb-8108-5646f782e17a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:07.181400 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ee8127dc-2ecc-47cb-8108-5646f782e17a tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.174054 Jun 16 18:14:07.181974 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 418/833] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:07 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:07.309889 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a6804ad3-5991-438d-bc66-7bd122594645 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:07.310562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a6804ad3-5991-438d-bc66-7bd122594645 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:07.317555 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a6804ad3-5991-438d-bc66-7bd122594645 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:07.318384 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a6804ad3-5991-438d-bc66-7bd122594645 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:07.319177 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a6804ad3-5991-438d-bc66-7bd122594645 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:07.319648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a6804ad3-5991-438d-bc66-7bd122594645 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:07.464578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a6804ad3-5991-438d-bc66-7bd122594645 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:07.468619 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a6804ad3-5991-438d-bc66-7bd122594645 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.162979 Jun 16 18:14:07.469202 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 416/834] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:07 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:08.204557 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-73fe8ea0-65f3-49f6-90d8-48815e71d36b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:08.205676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-73fe8ea0-65f3-49f6-90d8-48815e71d36b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:08.214715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-73fe8ea0-65f3-49f6-90d8-48815e71d36b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:08.215163 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-73fe8ea0-65f3-49f6-90d8-48815e71d36b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:08.215963 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-73fe8ea0-65f3-49f6-90d8-48815e71d36b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:08.216559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-73fe8ea0-65f3-49f6-90d8-48815e71d36b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:08.394379 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-73fe8ea0-65f3-49f6-90d8-48815e71d36b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:08.403070 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-73fe8ea0-65f3-49f6-90d8-48815e71d36b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1363 microversion: 2.1 time: 0.207804 Jun 16 18:14:08.403684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 419/835] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:08 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:08.487421 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d2cc3186-9787-4cbc-b245-dd3ad88942ec tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:08.487982 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d2cc3186-9787-4cbc-b245-dd3ad88942ec tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:08.495650 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d2cc3186-9787-4cbc-b245-dd3ad88942ec tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:08.496098 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d2cc3186-9787-4cbc-b245-dd3ad88942ec tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:08.496881 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d2cc3186-9787-4cbc-b245-dd3ad88942ec tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:08.497322 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d2cc3186-9787-4cbc-b245-dd3ad88942ec tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:08.666397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d2cc3186-9787-4cbc-b245-dd3ad88942ec tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:08.666397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:14:08.670497 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d2cc3186-9787-4cbc-b245-dd3ad88942ec tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.187201 Jun 16 18:14:08.671113 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 417/836] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:08 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:09.423475 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-84a890fd-169e-4884-838b-d05b24a26754 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:09.425273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-84a890fd-169e-4884-838b-d05b24a26754 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:09.433156 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-84a890fd-169e-4884-838b-d05b24a26754 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:09.433905 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-84a890fd-169e-4884-838b-d05b24a26754 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:09.434858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-84a890fd-169e-4884-838b-d05b24a26754 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:09.435290 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-84a890fd-169e-4884-838b-d05b24a26754 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:09.587895 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-84a890fd-169e-4884-838b-d05b24a26754 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:09.601798 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-84a890fd-169e-4884-838b-d05b24a26754 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1549 microversion: 2.1 time: 0.184243 Jun 16 18:14:09.602801 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 420/837] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:09 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1549 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:09.619465 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ddd1f3ea-f418-44f2-a60d-1abd44cdb8b7 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:09.620025 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ddd1f3ea-f418-44f2-a60d-1abd44cdb8b7 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:09.627927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ddd1f3ea-f418-44f2-a60d-1abd44cdb8b7 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:09.628379 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ddd1f3ea-f418-44f2-a60d-1abd44cdb8b7 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:09.629159 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ddd1f3ea-f418-44f2-a60d-1abd44cdb8b7 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:09.629603 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ddd1f3ea-f418-44f2-a60d-1abd44cdb8b7 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:09.688737 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-4eca6e48-ab43-4d0f-86a2-093bbe7c15cb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:09.689351 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-4eca6e48-ab43-4d0f-86a2-093bbe7c15cb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:09.696533 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4eca6e48-ab43-4d0f-86a2-093bbe7c15cb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:09.697067 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4eca6e48-ab43-4d0f-86a2-093bbe7c15cb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:09.697952 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4eca6e48-ab43-4d0f-86a2-093bbe7c15cb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:09.698452 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4eca6e48-ab43-4d0f-86a2-093bbe7c15cb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:09.715820 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ddd1f3ea-f418-44f2-a60d-1abd44cdb8b7 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099944 Jun 16 18:14:09.716848 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 418/838] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jun 16 18:14:09 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:14:09.966996 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4eca6e48-ab43-4d0f-86a2-093bbe7c15cb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:09.976854 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-4eca6e48-ab43-4d0f-86a2-093bbe7c15cb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.292002 Jun 16 18:14:09.977440 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 421/839] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:09 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:10.995758 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-51e96bcf-bd9c-40a8-8db7-9d50068fd198 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:10.996523 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-51e96bcf-bd9c-40a8-8db7-9d50068fd198 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:11.003548 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-51e96bcf-bd9c-40a8-8db7-9d50068fd198 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:11.004021 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-51e96bcf-bd9c-40a8-8db7-9d50068fd198 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:11.005042 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-51e96bcf-bd9c-40a8-8db7-9d50068fd198 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:11.005607 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-51e96bcf-bd9c-40a8-8db7-9d50068fd198 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:11.294847 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-51e96bcf-bd9c-40a8-8db7-9d50068fd198 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:11.296521 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-25cc0be8-8e27-4d69-9c1c-5ff492b4275d req-bbf580e3-af43-48ef-8582-38f8cce655c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ceb78ff-a348-4800-9bec-517f2cccc8c3", "tag": "62c371e1-4b97-4c82-8910-07da309b05e0"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:14:11.311616 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-51e96bcf-bd9c-40a8-8db7-9d50068fd198 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.320516 Jun 16 18:14:11.318209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-25cc0be8-8e27-4d69-9c1c-5ff492b4275d req-bbf580e3-af43-48ef-8582-38f8cce655c0 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:11.319304 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-25cc0be8-8e27-4d69-9c1c-5ff492b4275d req-bbf580e3-af43-48ef-8582-38f8cce655c0 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:11.328707 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 419/840] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:10 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:11.353247 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-25cc0be8-8e27-4d69-9c1c-5ff492b4275d req-bbf580e3-af43-48ef-8582-38f8cce655c0 service nova] Creating event network-changed:62c371e1-4b97-4c82-8910-07da309b05e0 for instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 on hv-cinder-83754 Jun 16 18:14:11.361710 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-25cc0be8-8e27-4d69-9c1c-5ff492b4275d req-bbf580e3-af43-48ef-8582-38f8cce655c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072978 Jun 16 18:14:11.362713 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 422/841] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:14:12.340713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-47a8c777-c0ee-411d-8d22-2a32fb8c00eb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:12.341330 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-47a8c777-c0ee-411d-8d22-2a32fb8c00eb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:12.348249 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-47a8c777-c0ee-411d-8d22-2a32fb8c00eb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:12.348695 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-47a8c777-c0ee-411d-8d22-2a32fb8c00eb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:12.350254 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-47a8c777-c0ee-411d-8d22-2a32fb8c00eb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:12.350884 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-47a8c777-c0ee-411d-8d22-2a32fb8c00eb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:12.507139 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-47a8c777-c0ee-411d-8d22-2a32fb8c00eb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:12.515663 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-47a8c777-c0ee-411d-8d22-2a32fb8c00eb tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.179021 Jun 16 18:14:12.516246 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 420/842] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:12 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:13.289807 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-f60fcde5-ff60-4cca-88f9-ebbf1b6a78d9 req-26cf771c-3b33-4c92-9691-88c86aa82f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6c9426-2d6f-4dfb-8bc8-959827d8cf79", "name": "network-vif-plugged", "status": "completed", "tag": "aaf3fae1-693c-4fec-8e06-dc30896dc3f7"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:14:13.301010 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-f60fcde5-ff60-4cca-88f9-ebbf1b6a78d9 req-26cf771c-3b33-4c92-9691-88c86aa82f3c service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:13.301010 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-f60fcde5-ff60-4cca-88f9-ebbf1b6a78d9 req-26cf771c-3b33-4c92-9691-88c86aa82f3c service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:13.316334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-f60fcde5-ff60-4cca-88f9-ebbf1b6a78d9 req-26cf771c-3b33-4c92-9691-88c86aa82f3c service nova] Creating event network-vif-plugged:aaf3fae1-693c-4fec-8e06-dc30896dc3f7 for instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79 on hv-cinder-83754 Jun 16 18:14:13.323965 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-f60fcde5-ff60-4cca-88f9-ebbf1b6a78d9 req-26cf771c-3b33-4c92-9691-88c86aa82f3c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040804 Jun 16 18:14:13.323965 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 423/843] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:14:13.534516 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-079e252a-9295-49fd-b6dc-41110c638496 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:13.535323 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-079e252a-9295-49fd-b6dc-41110c638496 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:13.544857 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-079e252a-9295-49fd-b6dc-41110c638496 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:13.553677 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-079e252a-9295-49fd-b6dc-41110c638496 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:13.553677 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-079e252a-9295-49fd-b6dc-41110c638496 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:13.553677 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-079e252a-9295-49fd-b6dc-41110c638496 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:13.714188 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-079e252a-9295-49fd-b6dc-41110c638496 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:13.722271 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-079e252a-9295-49fd-b6dc-41110c638496 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.192323 Jun 16 18:14:13.723031 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 421/844] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:13 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:14.741610 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b0c44ebb-450e-463a-8da1-b9fa0cc04f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:14.742303 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b0c44ebb-450e-463a-8da1-b9fa0cc04f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:14.749383 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b0c44ebb-450e-463a-8da1-b9fa0cc04f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:14.749881 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b0c44ebb-450e-463a-8da1-b9fa0cc04f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:14.750697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b0c44ebb-450e-463a-8da1-b9fa0cc04f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:14.751188 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b0c44ebb-450e-463a-8da1-b9fa0cc04f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:14.906580 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b0c44ebb-450e-463a-8da1-b9fa0cc04f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:14.915221 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b0c44ebb-450e-463a-8da1-b9fa0cc04f65 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1575 microversion: 2.1 time: 0.179348 Jun 16 18:14:14.915820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 424/845] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:14 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:15.932985 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b3afb085-6b26-44ea-b2a0-dfb2bc091844 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:15.933732 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b3afb085-6b26-44ea-b2a0-dfb2bc091844 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:15.940799 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b3afb085-6b26-44ea-b2a0-dfb2bc091844 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:15.941251 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b3afb085-6b26-44ea-b2a0-dfb2bc091844 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:15.942050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b3afb085-6b26-44ea-b2a0-dfb2bc091844 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:15.942516 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b3afb085-6b26-44ea-b2a0-dfb2bc091844 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:16.113057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b3afb085-6b26-44ea-b2a0-dfb2bc091844 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:16.121174 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b3afb085-6b26-44ea-b2a0-dfb2bc091844 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1562 microversion: 2.1 time: 0.192299 Jun 16 18:14:16.121752 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 422/846] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:15 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1562 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:38.804650 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-85fccdfe-f297-4173-a860-988e60f2bde3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:38.805489 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-85fccdfe-f297-4173-a860-988e60f2bde3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:38.808010 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=54 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:14:38.808738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=97 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:14:38.813719 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-85fccdfe-f297-4173-a860-988e60f2bde3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:38.814166 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-85fccdfe-f297-4173-a860-988e60f2bde3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:38.814933 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-85fccdfe-f297-4173-a860-988e60f2bde3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:38.815383 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-85fccdfe-f297-4173-a860-988e60f2bde3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:38.851083 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-85fccdfe-f297-4173-a860-988e60f2bde3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/ips" status: 200 len: 151 microversion: 2.1 time: 0.050878 Jun 16 18:14:38.852110 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 425/847] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jun 16 18:14:38 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:14:41.778295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4fa7e946-fc21-4f31-9279-a8cf611e1b81 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed890282-ec97-435a-ba45-655936701738"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:14:41.779597 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4fa7e946-fc21-4f31-9279-a8cf611e1b81 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:41.781623 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=55 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:14:41.782308 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=29 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:14:41.787804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4fa7e946-fc21-4f31-9279-a8cf611e1b81 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:41.790138 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4fa7e946-fc21-4f31-9279-a8cf611e1b81 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:41.790138 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4fa7e946-fc21-4f31-9279-a8cf611e1b81 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:41.790138 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4fa7e946-fc21-4f31-9279-a8cf611e1b81 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:42.806100 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4fa7e946-fc21-4f31-9279-a8cf611e1b81 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.027259 Jun 16 18:14:42.806100 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 423/848] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:14:41 2022] POST /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments => generated 194 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:14:54.600591 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-862bfdc7-cb42-4899-9be3-1933ac81510e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed890282-ec97-435a-ba45-655936701738"}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:14:54.601749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-862bfdc7-cb42-4899-9be3-1933ac81510e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:54.609798 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-862bfdc7-cb42-4899-9be3-1933ac81510e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:54.610240 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-862bfdc7-cb42-4899-9be3-1933ac81510e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:54.611001 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-862bfdc7-cb42-4899-9be3-1933ac81510e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:54.611466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-862bfdc7-cb42-4899-9be3-1933ac81510e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:54.695585 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-862bfdc7-cb42-4899-9be3-1933ac81510e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Invalid volume: volume ed890282-ec97-435a-ba45-655936701738 is already attached to instances: 5661854e-8257-40d2-a5a1-44224818fe5c Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-862bfdc7-cb42-4899-9be3-1933ac81510e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: POST /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments HTTP/1.1 Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 74 Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:14:54.697314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:14:54.698987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:14:54.698987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:14:54.698987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:14:54.698987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:14:54.698987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:14:54.698987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:14:54.698987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:14:54.698987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:14:54.698987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:14:54.698987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Jun 16 18:14:54.698987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {"volumeAttachment": {"volumeId": "ed890282-ec97-435a-ba45-655936701738"}} Jun 16 18:14:54.698987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Invalid volume: volume ed890282-ec97-435a-ba45-655936701738 is already attached to instances: 5661854e-8257-40d2-a5a1-44224818fe5c Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'server_id': '5661854e-8257-40d2-a5a1-44224818fe5c', 'body': {'volumeAttachment': {'volumeId': 'ed890282-ec97-435a-ba45-655936701738'}}} Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ed890282-ec97-435a-ba45-655936701738 is already attached to instances: 5661854e-8257-40d2-a5a1-44224818fe5c Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:14:54.699954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ed890282-ec97-435a-ba45-655936701738 is already attached to instances: 5661854e-8257-40d2-a5a1-44224818fe5c Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:14:54.701559 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:14:54.703102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:14:54.703102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:14:54.703102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:14:54.703102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ed890282-ec97-435a-ba45-655936701738 is already attached to instances: 5661854e-8257-40d2-a5a1-44224818fe5c Jun 16 18:14:54.703102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:14:54.703102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-862bfdc7-cb42-4899-9be3-1933ac81510e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 400 to user: Invalid volume: volume ed890282-ec97-435a-ba45-655936701738 is already attached to instances: 5661854e-8257-40d2-a5a1-44224818fe5c {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:14:54.703102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-862bfdc7-cb42-4899-9be3-1933ac81510e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102271 Jun 16 18:14:54.703102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 426/849] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:14:54 2022] POST /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:14:54.773524 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-abe2f131-9f43-4e88-aad7-afb058686e11 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:54.774140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-abe2f131-9f43-4e88-aad7-afb058686e11 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:54.776830 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:14:54.777501 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:14:54.782580 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-abe2f131-9f43-4e88-aad7-afb058686e11 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:54.785630 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-abe2f131-9f43-4e88-aad7-afb058686e11 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:54.785630 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-abe2f131-9f43-4e88-aad7-afb058686e11 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:54.785630 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-abe2f131-9f43-4e88-aad7-afb058686e11 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:54.870574 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-abe2f131-9f43-4e88-aad7-afb058686e11 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lazy-loading 'services' on Instance uuid 5661854e-8257-40d2-a5a1-44224818fe5c {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:14:55.159423 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-abe2f131-9f43-4e88-aad7-afb058686e11 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments/ed890282-ec97-435a-ba45-655936701738" status: 202 len: 0 microversion: 2.1 time: 0.389862 Jun 16 18:14:55.160140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 424/850] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jun 16 18:14:54 2022] DELETE /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments/ed890282-ec97-435a-ba45-655936701738 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:14:55.172628 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-03b0b14c-735f-4f1c-81b2-52e82096971e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:55.173875 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-03b0b14c-735f-4f1c-81b2-52e82096971e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:55.180314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-03b0b14c-735f-4f1c-81b2-52e82096971e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:55.180946 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-03b0b14c-735f-4f1c-81b2-52e82096971e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:55.182052 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-03b0b14c-735f-4f1c-81b2-52e82096971e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:55.182557 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-03b0b14c-735f-4f1c-81b2-52e82096971e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:55.215733 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-03b0b14c-735f-4f1c-81b2-52e82096971e tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047167 Jun 16 18:14:55.216297 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 427/851] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:14:55 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:14:56.228118 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9127ecdf-cdcb-4b9e-a380-ea5ddd01f441 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:56.229807 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9127ecdf-cdcb-4b9e-a380-ea5ddd01f441 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:56.237295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9127ecdf-cdcb-4b9e-a380-ea5ddd01f441 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:56.237730 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9127ecdf-cdcb-4b9e-a380-ea5ddd01f441 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:56.238495 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9127ecdf-cdcb-4b9e-a380-ea5ddd01f441 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:56.238926 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9127ecdf-cdcb-4b9e-a380-ea5ddd01f441 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:56.269930 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9127ecdf-cdcb-4b9e-a380-ea5ddd01f441 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046215 Jun 16 18:14:56.270491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 425/852] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:14:56 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:14:57.282821 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-500012c9-4dcf-450a-8e1f-f184fd617967 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:57.419548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-500012c9-4dcf-450a-8e1f-f184fd617967 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:57.419548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-500012c9-4dcf-450a-8e1f-f184fd617967 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:57.419548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-500012c9-4dcf-450a-8e1f-f184fd617967 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:57.419548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-500012c9-4dcf-450a-8e1f-f184fd617967 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:57.420724 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-500012c9-4dcf-450a-8e1f-f184fd617967 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:57.420724 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-500012c9-4dcf-450a-8e1f-f184fd617967 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061361 Jun 16 18:14:57.420724 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 428/853] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:14:57 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:14:57.420999 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-efe678cb-65eb-421f-9257-42462c839c49 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:57.420999 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-efe678cb-65eb-421f-9257-42462c839c49 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:57.420999 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-efe678cb-65eb-421f-9257-42462c839c49 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:57.420999 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-efe678cb-65eb-421f-9257-42462c839c49 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:57.421683 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-efe678cb-65eb-421f-9257-42462c839c49 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:57.421683 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-efe678cb-65eb-421f-9257-42462c839c49 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:57.445125 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-efe678cb-65eb-421f-9257-42462c839c49 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Going to try to terminate instance {{(pid=118162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:14:57.889980 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-efe678cb-65eb-421f-9257-42462c839c49 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 204 len: 0 microversion: 2.1 time: 0.484261 Jun 16 18:14:57.890572 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 426/854] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:14:57 2022] DELETE /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:14:57.900610 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a58e6ae8-8e0c-4f7a-baf3-361099c9f0eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:57.901316 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a58e6ae8-8e0c-4f7a-baf3-361099c9f0eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:57.907884 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a58e6ae8-8e0c-4f7a-baf3-361099c9f0eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:57.908331 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a58e6ae8-8e0c-4f7a-baf3-361099c9f0eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:57.909104 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a58e6ae8-8e0c-4f7a-baf3-361099c9f0eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:57.909532 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a58e6ae8-8e0c-4f7a-baf3-361099c9f0eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:58.062768 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a58e6ae8-8e0c-4f7a-baf3-361099c9f0eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:58.070766 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a58e6ae8-8e0c-4f7a-baf3-361099c9f0eb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1682 microversion: 2.1 time: 0.175596 Jun 16 18:14:58.071380 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 429/855] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:57 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:14:59.090315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-424c706c-89be-4e39-bcfa-625662d5e855 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:14:59.091020 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-424c706c-89be-4e39-bcfa-625662d5e855 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:14:59.097901 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-424c706c-89be-4e39-bcfa-625662d5e855 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:59.098348 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-424c706c-89be-4e39-bcfa-625662d5e855 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:59.099121 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-424c706c-89be-4e39-bcfa-625662d5e855 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:14:59.099589 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-424c706c-89be-4e39-bcfa-625662d5e855 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:14:59.281545 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-424c706c-89be-4e39-bcfa-625662d5e855 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:14:59.289431 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-424c706c-89be-4e39-bcfa-625662d5e855 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1682 microversion: 2.1 time: 0.204085 Jun 16 18:14:59.289966 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 427/856] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:14:59 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:00.308693 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1728f23c-8970-4a23-ac6c-c3a01ad21488 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:00.309303 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1728f23c-8970-4a23-ac6c-c3a01ad21488 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:00.316379 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1728f23c-8970-4a23-ac6c-c3a01ad21488 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:00.316859 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1728f23c-8970-4a23-ac6c-c3a01ad21488 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:00.317623 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1728f23c-8970-4a23-ac6c-c3a01ad21488 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:00.318055 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1728f23c-8970-4a23-ac6c-c3a01ad21488 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:00.560123 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1728f23c-8970-4a23-ac6c-c3a01ad21488 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:00.568860 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1728f23c-8970-4a23-ac6c-c3a01ad21488 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1682 microversion: 2.1 time: 0.264711 Jun 16 18:15:00.569429 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 430/857] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:00 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1682 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:01.177681 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-5b1516f9-35f9-4026-ac75-907eb6981661 req-8cb4aee8-350c-4ea6-9e7d-7ee349488d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5661854e-8257-40d2-a5a1-44224818fe5c", "name": "network-vif-deleted", "tag": "8072838b-95b3-4cd1-b019-78c95263a184"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:15:01.189745 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-5b1516f9-35f9-4026-ac75-907eb6981661 req-8cb4aee8-350c-4ea6-9e7d-7ee349488d16 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:01.190354 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-5b1516f9-35f9-4026-ac75-907eb6981661 req-8cb4aee8-350c-4ea6-9e7d-7ee349488d16 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:01.205062 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-5b1516f9-35f9-4026-ac75-907eb6981661 req-8cb4aee8-350c-4ea6-9e7d-7ee349488d16 service nova] Creating event network-vif-deleted:8072838b-95b3-4cd1-b019-78c95263a184 for instance 5661854e-8257-40d2-a5a1-44224818fe5c on hv-cinder-83754 Jun 16 18:15:01.211034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-5b1516f9-35f9-4026-ac75-907eb6981661 req-8cb4aee8-350c-4ea6-9e7d-7ee349488d16 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039536 Jun 16 18:15:01.224840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 428/858] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:01.586198 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-aa7515fa-e6a6-4dd4-8a83-cfba5c8d0afb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:01.586804 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-aa7515fa-e6a6-4dd4-8a83-cfba5c8d0afb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:01.595528 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aa7515fa-e6a6-4dd4-8a83-cfba5c8d0afb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:01.596015 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aa7515fa-e6a6-4dd4-8a83-cfba5c8d0afb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:01.596987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aa7515fa-e6a6-4dd4-8a83-cfba5c8d0afb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:01.597440 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aa7515fa-e6a6-4dd4-8a83-cfba5c8d0afb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:01.632256 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aa7515fa-e6a6-4dd4-8a83-cfba5c8d0afb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:01.632953 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aa7515fa-e6a6-4dd4-8a83-cfba5c8d0afb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:01.633400 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-aa7515fa-e6a6-4dd4-8a83-cfba5c8d0afb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lazy-loading 'fault' on Instance uuid 5661854e-8257-40d2-a5a1-44224818fe5c {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:15:01.682571 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-aa7515fa-e6a6-4dd4-8a83-cfba5c8d0afb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:01.690639 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-aa7515fa-e6a6-4dd4-8a83-cfba5c8d0afb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 200 len: 1331 microversion: 2.1 time: 0.108449 Jun 16 18:15:01.691992 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 431/859] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:01 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:02.718892 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d57a29f9-e1bf-474e-98b3-b234827c4b94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:02.719558 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d57a29f9-e1bf-474e-98b3-b234827c4b94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:02.728157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d57a29f9-e1bf-474e-98b3-b234827c4b94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:02.728667 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d57a29f9-e1bf-474e-98b3-b234827c4b94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:02.729464 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d57a29f9-e1bf-474e-98b3-b234827c4b94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:02.730838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d57a29f9-e1bf-474e-98b3-b234827c4b94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:02.746771 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-d57a29f9-e1bf-474e-98b3-b234827c4b94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d57a29f9-e1bf-474e-98b3-b234827c4b94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c HTTP/1.1 Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:15:02.748609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:15:02.750295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:15:02.750295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:15:02.750295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:15:02.750295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:15:02.750295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:15:02.750295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:15:02.750295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:15:02.750295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:15:02.750295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:15:02.750295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:15:02.750295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:15:02.750295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '5661854e-8257-40d2-a5a1-44224818fe5c'} Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:15:02.751157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:15:02.752468 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:15:02.753685 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d57a29f9-e1bf-474e-98b3-b234827c4b94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 404 to user: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:15:02.753685 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d57a29f9-e1bf-474e-98b3-b234827c4b94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 404 len: 111 microversion: 2.1 time: 0.036704 Jun 16 18:15:02.753685 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 429/860] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:02 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:15:02.762024 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a454b60b-3a7e-4e47-b8b1-6d2d157dea23 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '.version_select at 0x7f9c30372c10>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:02.897522 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a454b60b-3a7e-4e47-b8b1-6d2d157dea23 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979057260" status: 202 len: 0 microversion: 2.1 time: 0.140644 Jun 16 18:15:02.898279 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 432/861] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jun 16 18:15:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979057260 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:15:03.798981 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9cb53fcd-288a-4097-9239-9df0e87b7d72 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: .version_select at 0x7f9c23b50ee0>, body: {"keypair": {"name": "tempest-keypair-1580675369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATkjjj0Tp1TDfoP9SqHcih2TPxyidlPEEx3aVZ0gg4jnlxLByGIA26XGUzCP1XnjxGxmXLHKbHVIy9A2uaCwKVMobV0FOf8qZkByoLS/4vpmieTOPr5OqozbtRXYx9NWQ=="}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:15:03.814298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-9cb53fcd-288a-4097-9239-9df0e87b7d72 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'key_pairs'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:15:03.818361 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-9cb53fcd-288a-4097-9239-9df0e87b7d72 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for user 8498989e673d445dbc70aa9df55f391b and project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'key_pairs'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:15:04.069328 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9cb53fcd-288a-4097-9239-9df0e87b7d72 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.274312 Jun 16 18:15:04.069855 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 430/862] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jun 16 18:15:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:07.266555 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1037466232", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f17e2725-a961-43b0-9ec4-3a8964c308ae"}], "security_groups": [{"name": "tempest-securitygroup--1349706347"}], "key_name": "tempest-keypair-1580675369", "user_data": "}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:15:07.375032 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] validate_networks() for [('f17e2725-a961-43b0-9ec4-3a8964c308ae', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:15:07.774850 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:15:07.775664 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:15:07.776133 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:15:07.776704 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:15:07.777621 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:15:07.788678 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:07.789126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:07.790073 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:07.791673 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:07.810821 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:15:07.815292 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Getting quotas for user 8498989e673d445dbc70aa9df55f391b and project 5ad7a8c562934b3c843b10d79f31fee5. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:15:07.826752 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:15:07.829152 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:15:07.995413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-da758cfb-3b90-4623-86cc-10658528dddd tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.743352 Jun 16 18:15:08.002314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 433/863] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:15:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:15:08.007903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-145e4b9b-380b-4a58-bd81-2e118aecec2c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:08.008706 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-145e4b9b-380b-4a58-bd81-2e118aecec2c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:08.070633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-145e4b9b-380b-4a58-bd81-2e118aecec2c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:08.077743 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-145e4b9b-380b-4a58-bd81-2e118aecec2c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1242 microversion: 2.1 time: 0.074260 Jun 16 18:15:08.078349 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 431/864] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:08 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:15:09.094811 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ad2b0331-37a1-43e7-9758-060c7843dabe tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:09.095461 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ad2b0331-37a1-43e7-9758-060c7843dabe tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:09.151213 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ad2b0331-37a1-43e7-9758-060c7843dabe tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:09.157971 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ad2b0331-37a1-43e7-9758-060c7843dabe tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1242 microversion: 2.1 time: 0.067445 Jun 16 18:15:09.158543 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 434/865] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:09 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:10.174894 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3a6519f5-d760-4204-9ae7-a327a2b5e12f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:10.175543 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3a6519f5-d760-4204-9ae7-a327a2b5e12f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:10.185641 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3a6519f5-d760-4204-9ae7-a327a2b5e12f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:10.186152 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3a6519f5-d760-4204-9ae7-a327a2b5e12f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:10.186925 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3a6519f5-d760-4204-9ae7-a327a2b5e12f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:10.187381 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3a6519f5-d760-4204-9ae7-a327a2b5e12f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:10.253979 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3a6519f5-d760-4204-9ae7-a327a2b5e12f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:10.262239 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3a6519f5-d760-4204-9ae7-a327a2b5e12f tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1238 microversion: 2.1 time: 0.090720 Jun 16 18:15:10.263086 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 432/866] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:10 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:11.280496 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0c71881a-2ab8-4ec0-98ca-6e769af880b0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:11.281109 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0c71881a-2ab8-4ec0-98ca-6e769af880b0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:11.287680 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0c71881a-2ab8-4ec0-98ca-6e769af880b0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:11.288259 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0c71881a-2ab8-4ec0-98ca-6e769af880b0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:11.289204 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0c71881a-2ab8-4ec0-98ca-6e769af880b0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:11.289755 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0c71881a-2ab8-4ec0-98ca-6e769af880b0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:11.371659 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0c71881a-2ab8-4ec0-98ca-6e769af880b0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:11.379845 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0c71881a-2ab8-4ec0-98ca-6e769af880b0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1302 microversion: 2.1 time: 0.103663 Jun 16 18:15:11.380778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 435/867] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:11 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1302 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:12.398291 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-792d64df-c412-4df1-9b36-43f48a45d7c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:12.398903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-792d64df-c412-4df1-9b36-43f48a45d7c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:12.406612 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-792d64df-c412-4df1-9b36-43f48a45d7c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:12.407061 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-792d64df-c412-4df1-9b36-43f48a45d7c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:12.407856 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-792d64df-c412-4df1-9b36-43f48a45d7c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:12.408297 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-792d64df-c412-4df1-9b36-43f48a45d7c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:12.631729 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-792d64df-c412-4df1-9b36-43f48a45d7c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:12.640551 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-792d64df-c412-4df1-9b36-43f48a45d7c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1368 microversion: 2.1 time: 0.246154 Jun 16 18:15:12.641417 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 433/868] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:12 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:13.659226 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-67820b0c-acde-468f-a62a-fef601f95379 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:13.659811 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-67820b0c-acde-468f-a62a-fef601f95379 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:13.666305 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-67820b0c-acde-468f-a62a-fef601f95379 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:13.666754 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-67820b0c-acde-468f-a62a-fef601f95379 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:13.667551 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-67820b0c-acde-468f-a62a-fef601f95379 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:13.667987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-67820b0c-acde-468f-a62a-fef601f95379 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:13.811660 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-67820b0c-acde-468f-a62a-fef601f95379 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:13.819615 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-67820b0c-acde-468f-a62a-fef601f95379 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1368 microversion: 2.1 time: 0.164159 Jun 16 18:15:13.820186 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 436/869] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:13 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:15:13.948994 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-e5c3767f-0958-438c-a001-7b4e7cfc19e0 req-01f479bc-cb5a-4778-bced-6d5b4c43d82e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b20865bb-4685-49d2-bdcc-af22788bbd79", "tag": "82ce140e-3dae-4543-849e-c5dd94c7963f"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:15:13.960953 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-e5c3767f-0958-438c-a001-7b4e7cfc19e0 req-01f479bc-cb5a-4778-bced-6d5b4c43d82e service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:13.961980 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-e5c3767f-0958-438c-a001-7b4e7cfc19e0 req-01f479bc-cb5a-4778-bced-6d5b4c43d82e service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:13.985993 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-e5c3767f-0958-438c-a001-7b4e7cfc19e0 req-01f479bc-cb5a-4778-bced-6d5b4c43d82e service nova] Creating event network-changed:82ce140e-3dae-4543-849e-c5dd94c7963f for instance b20865bb-4685-49d2-bdcc-af22788bbd79 on hv-cinder-83754 Jun 16 18:15:13.991687 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-e5c3767f-0958-438c-a001-7b4e7cfc19e0 req-01f479bc-cb5a-4778-bced-6d5b4c43d82e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056336 Jun 16 18:15:13.992292 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 434/870] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:14.837605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b7ac5ee4-3ee9-427c-8dce-214406c9ea43 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:14.838259 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b7ac5ee4-3ee9-427c-8dce-214406c9ea43 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:14.845264 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b7ac5ee4-3ee9-427c-8dce-214406c9ea43 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:14.845705 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b7ac5ee4-3ee9-427c-8dce-214406c9ea43 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:14.846460 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b7ac5ee4-3ee9-427c-8dce-214406c9ea43 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:14.846887 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b7ac5ee4-3ee9-427c-8dce-214406c9ea43 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:14.984620 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b7ac5ee4-3ee9-427c-8dce-214406c9ea43 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:14.992143 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b7ac5ee4-3ee9-427c-8dce-214406c9ea43 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1368 microversion: 2.1 time: 0.158428 Jun 16 18:15:14.992788 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 437/871] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:14 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:16.010627 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ad8c3991-e8de-4287-9695-929707e0a53a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:16.011320 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ad8c3991-e8de-4287-9695-929707e0a53a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:16.018513 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ad8c3991-e8de-4287-9695-929707e0a53a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:16.018952 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ad8c3991-e8de-4287-9695-929707e0a53a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:16.019736 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ad8c3991-e8de-4287-9695-929707e0a53a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:16.020166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ad8c3991-e8de-4287-9695-929707e0a53a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:16.154848 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ad8c3991-e8de-4287-9695-929707e0a53a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:16.162425 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ad8c3991-e8de-4287-9695-929707e0a53a tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1368 microversion: 2.1 time: 0.156169 Jun 16 18:15:16.162981 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 435/872] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:16 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:17.180856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c478b167-ced4-41a6-bb80-41d5840e7ec1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:17.181711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c478b167-ced4-41a6-bb80-41d5840e7ec1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:17.190036 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c478b167-ced4-41a6-bb80-41d5840e7ec1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:17.190574 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c478b167-ced4-41a6-bb80-41d5840e7ec1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:17.191348 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c478b167-ced4-41a6-bb80-41d5840e7ec1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:17.191834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c478b167-ced4-41a6-bb80-41d5840e7ec1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:17.327780 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c478b167-ced4-41a6-bb80-41d5840e7ec1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:17.335737 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c478b167-ced4-41a6-bb80-41d5840e7ec1 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1368 microversion: 2.1 time: 0.158793 Jun 16 18:15:17.336322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 438/873] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:17 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:18.353559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d9d0d5b3-95e2-4bd1-8268-bb43fcc858e6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:18.355782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d9d0d5b3-95e2-4bd1-8268-bb43fcc858e6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:18.356651 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=6 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:15:18.362321 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d9d0d5b3-95e2-4bd1-8268-bb43fcc858e6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:18.362768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d9d0d5b3-95e2-4bd1-8268-bb43fcc858e6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:18.363645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d9d0d5b3-95e2-4bd1-8268-bb43fcc858e6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:18.364089 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d9d0d5b3-95e2-4bd1-8268-bb43fcc858e6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:18.503117 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d9d0d5b3-95e2-4bd1-8268-bb43fcc858e6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:18.510744 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d9d0d5b3-95e2-4bd1-8268-bb43fcc858e6 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1368 microversion: 2.1 time: 0.161019 Jun 16 18:15:18.511346 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 436/874] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:18 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:19.528308 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-27611e8a-17bd-4639-a038-55e4c525717b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:19.528917 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-27611e8a-17bd-4639-a038-55e4c525717b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:19.530771 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:15:19.531926 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=8 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:15:19.537402 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27611e8a-17bd-4639-a038-55e4c525717b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:19.537845 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27611e8a-17bd-4639-a038-55e4c525717b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:19.538612 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27611e8a-17bd-4639-a038-55e4c525717b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:19.539038 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-27611e8a-17bd-4639-a038-55e4c525717b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:19.690292 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-27611e8a-17bd-4639-a038-55e4c525717b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:19.698362 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-27611e8a-17bd-4639-a038-55e4c525717b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1368 microversion: 2.1 time: 0.174309 Jun 16 18:15:19.698931 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 439/875] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:19 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:19.719442 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-36760ec2-bb48-4ffb-aab0-5a605359c885 req-a6814a34-e77d-400d-ae16-bfcadb94f2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b20865bb-4685-49d2-bdcc-af22788bbd79", "name": "network-vif-plugged", "status": "completed", "tag": "82ce140e-3dae-4543-849e-c5dd94c7963f"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:15:19.728400 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-36760ec2-bb48-4ffb-aab0-5a605359c885 req-a6814a34-e77d-400d-ae16-bfcadb94f2eb service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:19.728843 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-36760ec2-bb48-4ffb-aab0-5a605359c885 req-a6814a34-e77d-400d-ae16-bfcadb94f2eb service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:19.740467 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-36760ec2-bb48-4ffb-aab0-5a605359c885 req-a6814a34-e77d-400d-ae16-bfcadb94f2eb service nova] Creating event network-vif-plugged:82ce140e-3dae-4543-849e-c5dd94c7963f for instance b20865bb-4685-49d2-bdcc-af22788bbd79 on hv-cinder-83754 Jun 16 18:15:19.745519 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-36760ec2-bb48-4ffb-aab0-5a605359c885 req-a6814a34-e77d-400d-ae16-bfcadb94f2eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030035 Jun 16 18:15:19.746110 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 437/876] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:20.717183 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c588c107-d642-4787-9e23-dd53be76464b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:20.717810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c588c107-d642-4787-9e23-dd53be76464b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:20.725658 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c588c107-d642-4787-9e23-dd53be76464b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:20.726108 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c588c107-d642-4787-9e23-dd53be76464b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:20.726876 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c588c107-d642-4787-9e23-dd53be76464b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:20.727312 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c588c107-d642-4787-9e23-dd53be76464b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:20.861168 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c588c107-d642-4787-9e23-dd53be76464b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:20.868804 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c588c107-d642-4787-9e23-dd53be76464b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1368 microversion: 2.1 time: 0.156020 Jun 16 18:15:20.869363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 440/877] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:20 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:21.887208 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8f2670fb-6c6f-4874-90bb-6d23324acc2b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:21.887843 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8f2670fb-6c6f-4874-90bb-6d23324acc2b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:21.895560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8f2670fb-6c6f-4874-90bb-6d23324acc2b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:21.896000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8f2670fb-6c6f-4874-90bb-6d23324acc2b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:21.896763 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8f2670fb-6c6f-4874-90bb-6d23324acc2b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:21.897334 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8f2670fb-6c6f-4874-90bb-6d23324acc2b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:22.038521 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8f2670fb-6c6f-4874-90bb-6d23324acc2b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:22.047011 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8f2670fb-6c6f-4874-90bb-6d23324acc2b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1368 microversion: 2.1 time: 0.164449 Jun 16 18:15:22.047715 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 438/878] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:21 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:23.067694 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e08451bf-2051-48c6-84fc-80d040e2b858 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:23.068264 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e08451bf-2051-48c6-84fc-80d040e2b858 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:23.075973 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e08451bf-2051-48c6-84fc-80d040e2b858 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:23.076673 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e08451bf-2051-48c6-84fc-80d040e2b858 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:23.077533 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e08451bf-2051-48c6-84fc-80d040e2b858 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:23.077967 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e08451bf-2051-48c6-84fc-80d040e2b858 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:23.229263 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e08451bf-2051-48c6-84fc-80d040e2b858 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:23.237107 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e08451bf-2051-48c6-84fc-80d040e2b858 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1558 microversion: 2.1 time: 0.174021 Jun 16 18:15:23.237659 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 441/879] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:23 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:23.254792 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2d41e321-2009-4151-a8fb-54f33fb1460d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:23.255910 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2d41e321-2009-4151-a8fb-54f33fb1460d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:23.263708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2d41e321-2009-4151-a8fb-54f33fb1460d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:23.264370 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2d41e321-2009-4151-a8fb-54f33fb1460d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:23.265179 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2d41e321-2009-4151-a8fb-54f33fb1460d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:23.265816 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2d41e321-2009-4151-a8fb-54f33fb1460d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:23.359476 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2d41e321-2009-4151-a8fb-54f33fb1460d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104305 Jun 16 18:15:23.359476 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 439/880] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Jun 16 18:15:23 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:24.061489 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ee46a5eb-3b31-4202-8742-b57d2479f564 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:24.065841 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ee46a5eb-3b31-4202-8742-b57d2479f564 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:24.069427 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ee46a5eb-3b31-4202-8742-b57d2479f564 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:24.070323 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ee46a5eb-3b31-4202-8742-b57d2479f564 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:24.071041 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ee46a5eb-3b31-4202-8742-b57d2479f564 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:24.071619 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ee46a5eb-3b31-4202-8742-b57d2479f564 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:24.097212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ee46a5eb-3b31-4202-8742-b57d2479f564 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/ips" status: 200 len: 152 microversion: 2.20 time: 0.039587 Jun 16 18:15:24.098001 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 442/881] 10.222.0.58 () {60 vars in 1288 bytes} [Thu Jun 16 18:15:24 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:15:24.493876 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-71bd5411-cb7d-49e3-a62f-fe8e7f4d4bc9 req-c79989db-871b-4572-9021-f58a5b2a6228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b20865bb-4685-49d2-bdcc-af22788bbd79", "tag": "82ce140e-3dae-4543-849e-c5dd94c7963f"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:15:24.506288 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-71bd5411-cb7d-49e3-a62f-fe8e7f4d4bc9 req-c79989db-871b-4572-9021-f58a5b2a6228 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:24.506757 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-71bd5411-cb7d-49e3-a62f-fe8e7f4d4bc9 req-c79989db-871b-4572-9021-f58a5b2a6228 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:24.531853 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-71bd5411-cb7d-49e3-a62f-fe8e7f4d4bc9 req-c79989db-871b-4572-9021-f58a5b2a6228 service nova] Creating event network-changed:82ce140e-3dae-4543-849e-c5dd94c7963f for instance b20865bb-4685-49d2-bdcc-af22788bbd79 on hv-cinder-83754 Jun 16 18:15:24.538479 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-71bd5411-cb7d-49e3-a62f-fe8e7f4d4bc9 req-c79989db-871b-4572-9021-f58a5b2a6228 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048261 Jun 16 18:15:24.539087 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 440/882] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:27.493430 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0ddac2be-7fd8-4b11-82dd-11e1b2a96e9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:15:27.493965 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0ddac2be-7fd8-4b11-82dd-11e1b2a96e9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:27.496506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:15:27.502132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0ddac2be-7fd8-4b11-82dd-11e1b2a96e9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:27.502600 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0ddac2be-7fd8-4b11-82dd-11e1b2a96e9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:27.503388 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0ddac2be-7fd8-4b11-82dd-11e1b2a96e9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:27.503850 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0ddac2be-7fd8-4b11-82dd-11e1b2a96e9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:27.508085 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=91 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:15:27.528603 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-0ddac2be-7fd8-4b11-82dd-11e1b2a96e9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lazy-loading 'flavor' on Instance uuid 4792d5b1-2139-4dc1-b191-7975b01fc093 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:15:28.334349 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0ddac2be-7fd8-4b11-82dd-11e1b2a96e9d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "POST /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/action" status: 202 len: 0 microversion: 2.20 time: 0.844864 Jun 16 18:15:28.335757 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 443/883] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Jun 16 18:15:27 2022] POST /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/action => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:15:28.347424 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2f0cb25b-239c-40ca-9917-5a39620b7754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:28.348668 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2f0cb25b-239c-40ca-9917-5a39620b7754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:28.352116 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:15:28.358747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f0cb25b-239c-40ca-9917-5a39620b7754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:28.359262 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f0cb25b-239c-40ca-9917-5a39620b7754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:28.360529 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f0cb25b-239c-40ca-9917-5a39620b7754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:28.361315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f0cb25b-239c-40ca-9917-5a39620b7754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:28.367058 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:15:28.526734 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2f0cb25b-239c-40ca-9917-5a39620b7754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:28.536511 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2f0cb25b-239c-40ca-9917-5a39620b7754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:28.539131 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2f0cb25b-239c-40ca-9917-5a39620b7754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:28.540417 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2f0cb25b-239c-40ca-9917-5a39620b7754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.200278 Jun 16 18:15:28.540981 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 441/884] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:28 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:29.560294 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c174c42d-fd67-4c37-a4e1-98b1dcd79453 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:29.560916 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c174c42d-fd67-4c37-a4e1-98b1dcd79453 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:29.567668 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c174c42d-fd67-4c37-a4e1-98b1dcd79453 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:29.568252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c174c42d-fd67-4c37-a4e1-98b1dcd79453 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:29.568930 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c174c42d-fd67-4c37-a4e1-98b1dcd79453 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:29.569361 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c174c42d-fd67-4c37-a4e1-98b1dcd79453 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:29.722642 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c174c42d-fd67-4c37-a4e1-98b1dcd79453 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:29.733094 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c174c42d-fd67-4c37-a4e1-98b1dcd79453 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:29.734628 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c174c42d-fd67-4c37-a4e1-98b1dcd79453 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:29.735872 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c174c42d-fd67-4c37-a4e1-98b1dcd79453 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.180607 Jun 16 18:15:29.737238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 444/885] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:29 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:30.757131 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8f2cea38-fc60-431b-9d74-cbc03d255627 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:30.757682 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8f2cea38-fc60-431b-9d74-cbc03d255627 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:30.766145 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8f2cea38-fc60-431b-9d74-cbc03d255627 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:30.766593 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8f2cea38-fc60-431b-9d74-cbc03d255627 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:30.768046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8f2cea38-fc60-431b-9d74-cbc03d255627 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:30.768508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8f2cea38-fc60-431b-9d74-cbc03d255627 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:30.921537 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8f2cea38-fc60-431b-9d74-cbc03d255627 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:30.930337 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8f2cea38-fc60-431b-9d74-cbc03d255627 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:30.931907 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8f2cea38-fc60-431b-9d74-cbc03d255627 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:30.933076 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8f2cea38-fc60-431b-9d74-cbc03d255627 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.181367 Jun 16 18:15:30.933632 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 442/886] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:30 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:31.952261 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c63caab1-609d-4f11-9691-e8a6fc93c5e1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:31.952944 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c63caab1-609d-4f11-9691-e8a6fc93c5e1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:31.960987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c63caab1-609d-4f11-9691-e8a6fc93c5e1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:31.961427 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c63caab1-609d-4f11-9691-e8a6fc93c5e1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:31.962216 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c63caab1-609d-4f11-9691-e8a6fc93c5e1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:31.962645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c63caab1-609d-4f11-9691-e8a6fc93c5e1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:32.106387 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c63caab1-609d-4f11-9691-e8a6fc93c5e1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:32.114797 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c63caab1-609d-4f11-9691-e8a6fc93c5e1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:32.116332 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c63caab1-609d-4f11-9691-e8a6fc93c5e1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:32.117493 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c63caab1-609d-4f11-9691-e8a6fc93c5e1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.169093 Jun 16 18:15:32.118053 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 445/887] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:31 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:15:33.137599 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4a642f97-d210-410b-ab22-d1dbb2e3de47 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:33.138231 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4a642f97-d210-410b-ab22-d1dbb2e3de47 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:33.146670 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4a642f97-d210-410b-ab22-d1dbb2e3de47 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:33.147112 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4a642f97-d210-410b-ab22-d1dbb2e3de47 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:33.147927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4a642f97-d210-410b-ab22-d1dbb2e3de47 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:33.148362 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4a642f97-d210-410b-ab22-d1dbb2e3de47 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:33.299947 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4a642f97-d210-410b-ab22-d1dbb2e3de47 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:33.309015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4a642f97-d210-410b-ab22-d1dbb2e3de47 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:33.310710 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4a642f97-d210-410b-ab22-d1dbb2e3de47 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:33.312004 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4a642f97-d210-410b-ab22-d1dbb2e3de47 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.179428 Jun 16 18:15:33.312559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 443/888] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:33 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:34.331683 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-276225a2-4980-4b69-9c77-684c96b08851 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:34.332252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-276225a2-4980-4b69-9c77-684c96b08851 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:34.338984 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-276225a2-4980-4b69-9c77-684c96b08851 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:34.339461 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-276225a2-4980-4b69-9c77-684c96b08851 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:34.340238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-276225a2-4980-4b69-9c77-684c96b08851 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:34.340672 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-276225a2-4980-4b69-9c77-684c96b08851 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:34.489981 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-276225a2-4980-4b69-9c77-684c96b08851 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:34.500709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-276225a2-4980-4b69-9c77-684c96b08851 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:34.503301 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-276225a2-4980-4b69-9c77-684c96b08851 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:34.504538 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-276225a2-4980-4b69-9c77-684c96b08851 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.177714 Jun 16 18:15:34.505273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 446/889] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:34 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:35.523212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f49a17f8-a8b2-429d-939a-551dd690e996 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:35.523807 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f49a17f8-a8b2-429d-939a-551dd690e996 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:35.530706 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f49a17f8-a8b2-429d-939a-551dd690e996 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:35.531531 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f49a17f8-a8b2-429d-939a-551dd690e996 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:35.532747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f49a17f8-a8b2-429d-939a-551dd690e996 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:35.533272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f49a17f8-a8b2-429d-939a-551dd690e996 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:35.697504 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f49a17f8-a8b2-429d-939a-551dd690e996 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:35.707545 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f49a17f8-a8b2-429d-939a-551dd690e996 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:35.710611 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f49a17f8-a8b2-429d-939a-551dd690e996 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:35.710611 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f49a17f8-a8b2-429d-939a-551dd690e996 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.191886 Jun 16 18:15:35.711007 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 444/890] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:35 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:36.730541 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d4daf7be-105a-4caa-a78c-9ed12f82af7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:36.731192 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d4daf7be-105a-4caa-a78c-9ed12f82af7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:36.737796 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d4daf7be-105a-4caa-a78c-9ed12f82af7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:36.738238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d4daf7be-105a-4caa-a78c-9ed12f82af7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:36.738991 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d4daf7be-105a-4caa-a78c-9ed12f82af7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:36.739491 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d4daf7be-105a-4caa-a78c-9ed12f82af7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:36.870049 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d4daf7be-105a-4caa-a78c-9ed12f82af7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:36.878738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d4daf7be-105a-4caa-a78c-9ed12f82af7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:36.880271 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d4daf7be-105a-4caa-a78c-9ed12f82af7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:36.881431 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d4daf7be-105a-4caa-a78c-9ed12f82af7c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.154916 Jun 16 18:15:36.881985 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 447/891] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:36 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:37.900142 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-24c63f93-39d1-4cbe-8160-40d73b9a02e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:37.900850 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-24c63f93-39d1-4cbe-8160-40d73b9a02e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:37.907904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24c63f93-39d1-4cbe-8160-40d73b9a02e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:37.908467 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24c63f93-39d1-4cbe-8160-40d73b9a02e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:37.909232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24c63f93-39d1-4cbe-8160-40d73b9a02e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:37.909667 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24c63f93-39d1-4cbe-8160-40d73b9a02e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:38.057399 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-24c63f93-39d1-4cbe-8160-40d73b9a02e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:38.065737 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-24c63f93-39d1-4cbe-8160-40d73b9a02e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:38.067246 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-24c63f93-39d1-4cbe-8160-40d73b9a02e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:38.068484 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-24c63f93-39d1-4cbe-8160-40d73b9a02e4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.172386 Jun 16 18:15:38.069041 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 445/892] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:37 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:39.087674 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-74edbb36-66ff-497f-bf02-7cecae57cf02 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:39.088231 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-74edbb36-66ff-497f-bf02-7cecae57cf02 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:39.094952 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-74edbb36-66ff-497f-bf02-7cecae57cf02 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:39.095567 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-74edbb36-66ff-497f-bf02-7cecae57cf02 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:39.096736 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-74edbb36-66ff-497f-bf02-7cecae57cf02 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:39.097191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-74edbb36-66ff-497f-bf02-7cecae57cf02 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:39.229478 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-74edbb36-66ff-497f-bf02-7cecae57cf02 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:39.238304 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-74edbb36-66ff-497f-bf02-7cecae57cf02 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:39.239680 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-74edbb36-66ff-497f-bf02-7cecae57cf02 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:39.240834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-74edbb36-66ff-497f-bf02-7cecae57cf02 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.157282 Jun 16 18:15:39.241388 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 448/893] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:39 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:40.258773 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-7af0177b-ac3c-4d58-8352-09bec72b246d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:40.259488 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-7af0177b-ac3c-4d58-8352-09bec72b246d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:40.267246 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7af0177b-ac3c-4d58-8352-09bec72b246d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:40.267793 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7af0177b-ac3c-4d58-8352-09bec72b246d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:40.268565 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7af0177b-ac3c-4d58-8352-09bec72b246d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:40.268990 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-7af0177b-ac3c-4d58-8352-09bec72b246d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:40.411493 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7af0177b-ac3c-4d58-8352-09bec72b246d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:40.419515 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7af0177b-ac3c-4d58-8352-09bec72b246d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:40.421188 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-7af0177b-ac3c-4d58-8352-09bec72b246d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:40.422334 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-7af0177b-ac3c-4d58-8352-09bec72b246d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.167613 Jun 16 18:15:40.422890 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 446/894] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:40 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:15:41.075116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9cd4e083-19a5-4443-83fd-e503a645be33 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:41.075705 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9cd4e083-19a5-4443-83fd-e503a645be33 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:41.081755 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9cd4e083-19a5-4443-83fd-e503a645be33 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:41.086094 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9cd4e083-19a5-4443-83fd-e503a645be33 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:41.086094 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9cd4e083-19a5-4443-83fd-e503a645be33 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:41.086094 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9cd4e083-19a5-4443-83fd-e503a645be33 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:41.107087 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9cd4e083-19a5-4443-83fd-e503a645be33 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/ips" status: 200 len: 145 microversion: 2.1 time: 0.036302 Jun 16 18:15:41.107685 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 449/895] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jun 16 18:15:41 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:41.439815 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1f6f6c3a-fadf-422c-8b58-beba175bcb01 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:41.440438 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1f6f6c3a-fadf-422c-8b58-beba175bcb01 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:41.447263 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1f6f6c3a-fadf-422c-8b58-beba175bcb01 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:41.447761 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1f6f6c3a-fadf-422c-8b58-beba175bcb01 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:41.448563 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1f6f6c3a-fadf-422c-8b58-beba175bcb01 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:41.448996 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1f6f6c3a-fadf-422c-8b58-beba175bcb01 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:41.582309 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1f6f6c3a-fadf-422c-8b58-beba175bcb01 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:41.597007 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1f6f6c3a-fadf-422c-8b58-beba175bcb01 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:41.600040 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1f6f6c3a-fadf-422c-8b58-beba175bcb01 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:41.601273 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1f6f6c3a-fadf-422c-8b58-beba175bcb01 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.165361 Jun 16 18:15:41.601893 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 447/896] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:41 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:42.620285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d948f458-9a70-41ff-84fd-1018403a51ee tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:42.620991 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d948f458-9a70-41ff-84fd-1018403a51ee tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:42.627944 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d948f458-9a70-41ff-84fd-1018403a51ee tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:42.628386 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d948f458-9a70-41ff-84fd-1018403a51ee tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:42.629147 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d948f458-9a70-41ff-84fd-1018403a51ee tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:42.629571 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d948f458-9a70-41ff-84fd-1018403a51ee tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:42.767848 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d948f458-9a70-41ff-84fd-1018403a51ee tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:42.776780 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d948f458-9a70-41ff-84fd-1018403a51ee tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:42.778293 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d948f458-9a70-41ff-84fd-1018403a51ee tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:42.779500 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d948f458-9a70-41ff-84fd-1018403a51ee tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.163099 Jun 16 18:15:42.780128 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 450/897] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:42 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:43.798547 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-497c8968-4878-4314-899b-5c89eda512d2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:43.799359 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-497c8968-4878-4314-899b-5c89eda512d2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:43.807554 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-497c8968-4878-4314-899b-5c89eda512d2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:43.808106 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-497c8968-4878-4314-899b-5c89eda512d2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:43.809000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-497c8968-4878-4314-899b-5c89eda512d2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:43.809607 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-497c8968-4878-4314-899b-5c89eda512d2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:43.948849 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-497c8968-4878-4314-899b-5c89eda512d2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:43.958218 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-497c8968-4878-4314-899b-5c89eda512d2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:43.958490 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-497c8968-4878-4314-899b-5c89eda512d2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:43.959715 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-497c8968-4878-4314-899b-5c89eda512d2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1745 microversion: 2.20 time: 0.165361 Jun 16 18:15:43.960267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 448/898] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:43 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:44.106522 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f7496590-72ca-42fe-b21f-b0260f825586 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbd0d343-4081-4728-8ae2-8914eb36cf1f"}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:15:44.107804 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f7496590-72ca-42fe-b21f-b0260f825586 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:44.114724 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7496590-72ca-42fe-b21f-b0260f825586 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:44.115460 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7496590-72ca-42fe-b21f-b0260f825586 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:44.128741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7496590-72ca-42fe-b21f-b0260f825586 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:44.128741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f7496590-72ca-42fe-b21f-b0260f825586 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:44.981410 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1bda3b11-76da-4c49-bf88-3bfedba66053 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:44.982467 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1bda3b11-76da-4c49-bf88-3bfedba66053 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:44.989091 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1bda3b11-76da-4c49-bf88-3bfedba66053 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:44.990152 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1bda3b11-76da-4c49-bf88-3bfedba66053 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:44.991167 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1bda3b11-76da-4c49-bf88-3bfedba66053 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:44.991736 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1bda3b11-76da-4c49-bf88-3bfedba66053 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:45.131622 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1bda3b11-76da-4c49-bf88-3bfedba66053 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:45.139976 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1bda3b11-76da-4c49-bf88-3bfedba66053 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:45.141482 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1bda3b11-76da-4c49-bf88-3bfedba66053 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:45.142657 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1bda3b11-76da-4c49-bf88-3bfedba66053 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1745 microversion: 2.20 time: 0.167131 Jun 16 18:15:45.143205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 449/899] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:44 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:45.507089 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f7496590-72ca-42fe-b21f-b0260f825586 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "POST /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.404379 Jun 16 18:15:45.507851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 451/900] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:15:44 2022] POST /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments => generated 194 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:45.776112 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-d270463d-60b5-4abf-9205-0f552afe850c req-8ddfb4ee-d22b-4404-afb9-30c2143aec52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4792d5b1-2139-4dc1-b191-7975b01fc093", "name": "network-vif-plugged", "status": "completed", "tag": "7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:15:45.785353 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-d270463d-60b5-4abf-9205-0f552afe850c req-8ddfb4ee-d22b-4404-afb9-30c2143aec52 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:45.785799 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-d270463d-60b5-4abf-9205-0f552afe850c req-8ddfb4ee-d22b-4404-afb9-30c2143aec52 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:45.801694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-d270463d-60b5-4abf-9205-0f552afe850c req-8ddfb4ee-d22b-4404-afb9-30c2143aec52 service nova] Creating event network-vif-plugged:7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e for instance 4792d5b1-2139-4dc1-b191-7975b01fc093 on hv-cinder-83754 Jun 16 18:15:45.806892 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-d270463d-60b5-4abf-9205-0f552afe850c req-8ddfb4ee-d22b-4404-afb9-30c2143aec52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034838 Jun 16 18:15:45.807530 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 450/901] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:46.162874 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-03eeff84-0bcc-442c-8cfc-5368c812d754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:46.163474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-03eeff84-0bcc-442c-8cfc-5368c812d754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:46.170026 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-03eeff84-0bcc-442c-8cfc-5368c812d754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:46.170465 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-03eeff84-0bcc-442c-8cfc-5368c812d754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:46.171266 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-03eeff84-0bcc-442c-8cfc-5368c812d754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:46.171766 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-03eeff84-0bcc-442c-8cfc-5368c812d754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:46.313400 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-03eeff84-0bcc-442c-8cfc-5368c812d754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:46.323241 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-03eeff84-0bcc-442c-8cfc-5368c812d754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:46.329167 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-03eeff84-0bcc-442c-8cfc-5368c812d754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:46.329167 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-03eeff84-0bcc-442c-8cfc-5368c812d754 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1745 microversion: 2.20 time: 0.168088 Jun 16 18:15:46.329167 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 452/902] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:46 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:47.346538 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4fe1d91c-9735-4d5b-8bf5-10a8070c7409 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:47.347210 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4fe1d91c-9735-4d5b-8bf5-10a8070c7409 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:47.358318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4fe1d91c-9735-4d5b-8bf5-10a8070c7409 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:47.358318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4fe1d91c-9735-4d5b-8bf5-10a8070c7409 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:47.358318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4fe1d91c-9735-4d5b-8bf5-10a8070c7409 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:47.358318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4fe1d91c-9735-4d5b-8bf5-10a8070c7409 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:47.651649 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4fe1d91c-9735-4d5b-8bf5-10a8070c7409 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:47.660026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4fe1d91c-9735-4d5b-8bf5-10a8070c7409 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:47.661578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4fe1d91c-9735-4d5b-8bf5-10a8070c7409 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:47.671659 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4fe1d91c-9735-4d5b-8bf5-10a8070c7409 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1745 microversion: 2.20 time: 0.321304 Jun 16 18:15:47.671659 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 451/903] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:47 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1745 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:48.682580 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f56b962d-2dd3-4444-881b-0b2c5e322b6d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:48.683400 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f56b962d-2dd3-4444-881b-0b2c5e322b6d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:48.691154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f56b962d-2dd3-4444-881b-0b2c5e322b6d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:48.691762 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f56b962d-2dd3-4444-881b-0b2c5e322b6d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:48.692639 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f56b962d-2dd3-4444-881b-0b2c5e322b6d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:48.693125 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f56b962d-2dd3-4444-881b-0b2c5e322b6d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:48.880172 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f56b962d-2dd3-4444-881b-0b2c5e322b6d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:48.895454 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f56b962d-2dd3-4444-881b-0b2c5e322b6d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:48.899119 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f56b962d-2dd3-4444-881b-0b2c5e322b6d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:48.901530 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f56b962d-2dd3-4444-881b-0b2c5e322b6d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1745 microversion: 2.20 time: 0.223586 Jun 16 18:15:48.902500 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 453/904] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:48 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1745 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:49.927052 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8b0682b6-fc7e-49fb-8ad3-448e1c95b1ef tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:49.927640 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8b0682b6-fc7e-49fb-8ad3-448e1c95b1ef tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:49.935094 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8b0682b6-fc7e-49fb-8ad3-448e1c95b1ef tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:49.941466 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8b0682b6-fc7e-49fb-8ad3-448e1c95b1ef tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:49.941466 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8b0682b6-fc7e-49fb-8ad3-448e1c95b1ef tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:49.941466 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8b0682b6-fc7e-49fb-8ad3-448e1c95b1ef tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:50.094493 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8b0682b6-fc7e-49fb-8ad3-448e1c95b1ef tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:50.102981 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8b0682b6-fc7e-49fb-8ad3-448e1c95b1ef tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:50.104701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8b0682b6-fc7e-49fb-8ad3-448e1c95b1ef tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:50.106092 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8b0682b6-fc7e-49fb-8ad3-448e1c95b1ef tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1745 microversion: 2.20 time: 0.183028 Jun 16 18:15:50.106821 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 452/905] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:49 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:51.125551 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0d638558-94e7-4e0b-a733-4d2aa1679770 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:51.126189 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0d638558-94e7-4e0b-a733-4d2aa1679770 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:51.132914 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0d638558-94e7-4e0b-a733-4d2aa1679770 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:51.133357 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0d638558-94e7-4e0b-a733-4d2aa1679770 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:51.134176 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0d638558-94e7-4e0b-a733-4d2aa1679770 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:51.134617 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0d638558-94e7-4e0b-a733-4d2aa1679770 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:51.279596 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0d638558-94e7-4e0b-a733-4d2aa1679770 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:51.291968 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0d638558-94e7-4e0b-a733-4d2aa1679770 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:51.293527 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0d638558-94e7-4e0b-a733-4d2aa1679770 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:51.295130 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0d638558-94e7-4e0b-a733-4d2aa1679770 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1745 microversion: 2.20 time: 0.173383 Jun 16 18:15:51.295659 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 454/906] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:51 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:15:52.315267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9244bae2-5812-47e4-8fc9-01acdb864ad5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:52.315912 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9244bae2-5812-47e4-8fc9-01acdb864ad5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:52.345494 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9244bae2-5812-47e4-8fc9-01acdb864ad5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:52.348888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9244bae2-5812-47e4-8fc9-01acdb864ad5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:52.350119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9244bae2-5812-47e4-8fc9-01acdb864ad5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:52.350577 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9244bae2-5812-47e4-8fc9-01acdb864ad5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:52.539445 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9244bae2-5812-47e4-8fc9-01acdb864ad5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:52.552106 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9244bae2-5812-47e4-8fc9-01acdb864ad5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:52.556193 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9244bae2-5812-47e4-8fc9-01acdb864ad5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:52.558726 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9244bae2-5812-47e4-8fc9-01acdb864ad5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.247905 Jun 16 18:15:52.571339 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 453/907] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:52 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:53.579688 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-545dfa10-035a-4738-855f-702d3f4ec39a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:53.581177 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-545dfa10-035a-4738-855f-702d3f4ec39a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:53.591035 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-545dfa10-035a-4738-855f-702d3f4ec39a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:53.591553 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-545dfa10-035a-4738-855f-702d3f4ec39a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:53.592588 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-545dfa10-035a-4738-855f-702d3f4ec39a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:53.593201 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-545dfa10-035a-4738-855f-702d3f4ec39a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:53.810027 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-545dfa10-035a-4738-855f-702d3f4ec39a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:53.826694 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-545dfa10-035a-4738-855f-702d3f4ec39a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:53.829002 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-545dfa10-035a-4738-855f-702d3f4ec39a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:53.830544 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-545dfa10-035a-4738-855f-702d3f4ec39a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.255301 Jun 16 18:15:53.844245 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 455/908] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:53 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:54.765062 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-385ea108-cc79-4a14-b1b0-4a4e10172e1b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:54.767680 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-385ea108-cc79-4a14-b1b0-4a4e10172e1b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:54.780974 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-385ea108-cc79-4a14-b1b0-4a4e10172e1b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:54.783950 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-385ea108-cc79-4a14-b1b0-4a4e10172e1b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:54.784862 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-385ea108-cc79-4a14-b1b0-4a4e10172e1b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:54.785367 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-385ea108-cc79-4a14-b1b0-4a4e10172e1b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:54.840294 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-385ea108-cc79-4a14-b1b0-4a4e10172e1b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082783 Jun 16 18:15:54.840975 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 454/909] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:15:54 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:54.851222 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6f70304a-93c6-4258-bdcc-4bcc859af102 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:54.853326 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6f70304a-93c6-4258-bdcc-4bcc859af102 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:54.858709 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9ac0dd74-03d6-4246-9ad7-0775dd556c9e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:54.859693 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9ac0dd74-03d6-4246-9ad7-0775dd556c9e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:54.872063 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f70304a-93c6-4258-bdcc-4bcc859af102 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:54.872717 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f70304a-93c6-4258-bdcc-4bcc859af102 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:54.874158 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f70304a-93c6-4258-bdcc-4bcc859af102 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:54.874920 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f70304a-93c6-4258-bdcc-4bcc859af102 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:54.876063 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9ac0dd74-03d6-4246-9ad7-0775dd556c9e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:54.876625 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9ac0dd74-03d6-4246-9ad7-0775dd556c9e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:54.877790 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9ac0dd74-03d6-4246-9ad7-0775dd556c9e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:54.878456 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9ac0dd74-03d6-4246-9ad7-0775dd556c9e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:54.933561 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9ac0dd74-03d6-4246-9ad7-0775dd556c9e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments/dbd0d343-4081-4728-8ae2-8914eb36cf1f" status: 200 len: 194 microversion: 2.1 time: 0.085977 Jun 16 18:15:54.934828 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 455/910] 10.222.0.58 () {58 vars in 1412 bytes} [Thu Jun 16 18:15:54 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments/dbd0d343-4081-4728-8ae2-8914eb36cf1f => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:55.087790 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6f70304a-93c6-4258-bdcc-4bcc859af102 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:55.096481 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:15:55.107481 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6f70304a-93c6-4258-bdcc-4bcc859af102 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:55.111984 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6f70304a-93c6-4258-bdcc-4bcc859af102 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:55.113504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6f70304a-93c6-4258-bdcc-4bcc859af102 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.267339 Jun 16 18:15:55.114751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 456/911] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:54 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:56.139017 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f8904d05-b8fd-4f84-a41d-a97d5a9e5316 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:56.139818 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f8904d05-b8fd-4f84-a41d-a97d5a9e5316 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:56.149547 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f8904d05-b8fd-4f84-a41d-a97d5a9e5316 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:56.150056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f8904d05-b8fd-4f84-a41d-a97d5a9e5316 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:56.150881 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f8904d05-b8fd-4f84-a41d-a97d5a9e5316 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:56.151329 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f8904d05-b8fd-4f84-a41d-a97d5a9e5316 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:56.309260 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f8904d05-b8fd-4f84-a41d-a97d5a9e5316 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:56.319823 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f8904d05-b8fd-4f84-a41d-a97d5a9e5316 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:56.322150 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f8904d05-b8fd-4f84-a41d-a97d5a9e5316 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:56.323430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f8904d05-b8fd-4f84-a41d-a97d5a9e5316 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.188780 Jun 16 18:15:56.324009 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 456/912] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:56 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:57.350408 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-64dcd051-3a29-4d05-9895-552b871b8ef2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:57.352483 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-64dcd051-3a29-4d05-9895-552b871b8ef2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:57.363617 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-64dcd051-3a29-4d05-9895-552b871b8ef2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:57.364569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-64dcd051-3a29-4d05-9895-552b871b8ef2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:57.366576 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-64dcd051-3a29-4d05-9895-552b871b8ef2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:57.367774 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-64dcd051-3a29-4d05-9895-552b871b8ef2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:58.069020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-64dcd051-3a29-4d05-9895-552b871b8ef2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:58.076710 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4ea9af96-2a9b-4dd9-b0c1-ab450c4bc87b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "165dae85-965e-4d4c-91a6-a2c34c999abe"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:15:58.086209 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4ea9af96-2a9b-4dd9-b0c1-ab450c4bc87b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:58.103315 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-64dcd051-3a29-4d05-9895-552b871b8ef2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:58.105915 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-64dcd051-3a29-4d05-9895-552b871b8ef2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:58.108857 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4ea9af96-2a9b-4dd9-b0c1-ab450c4bc87b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:58.109610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4ea9af96-2a9b-4dd9-b0c1-ab450c4bc87b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:58.110903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4ea9af96-2a9b-4dd9-b0c1-ab450c4bc87b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:58.111648 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4ea9af96-2a9b-4dd9-b0c1-ab450c4bc87b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:58.114191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-64dcd051-3a29-4d05-9895-552b871b8ef2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.770272 Jun 16 18:15:58.123710 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 457/913] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:57 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:15:58.442378 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-941d28f0-135c-4efb-a164-b3eeb33df971 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:58.445870 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-941d28f0-135c-4efb-a164-b3eeb33df971 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:58.452012 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=30 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:15:58.462908 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-941d28f0-135c-4efb-a164-b3eeb33df971 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:58.464135 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-941d28f0-135c-4efb-a164-b3eeb33df971 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:58.466091 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-941d28f0-135c-4efb-a164-b3eeb33df971 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:58.466946 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:15:58.467161 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-941d28f0-135c-4efb-a164-b3eeb33df971 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:58.511548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-941d28f0-135c-4efb-a164-b3eeb33df971 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Going to try to terminate instance {{(pid=118161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:15:59.007351 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-941d28f0-135c-4efb-a164-b3eeb33df971 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "DELETE /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 204 len: 0 microversion: 2.1 time: 0.570568 Jun 16 18:15:59.012769 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 458/914] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:15:58 2022] DELETE /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:15:59.017814 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-ba19d0e7-cdb8-47ae-a7d8-5512e502c186 req-eaae1357-6c34-4071-afbb-7031b82f4973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6c9426-2d6f-4dfb-8bc8-959827d8cf79", "tag": "aaf3fae1-693c-4fec-8e06-dc30896dc3f7"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:15:59.032248 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-ba19d0e7-cdb8-47ae-a7d8-5512e502c186 req-eaae1357-6c34-4071-afbb-7031b82f4973 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:59.032704 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-ba19d0e7-cdb8-47ae-a7d8-5512e502c186 req-eaae1357-6c34-4071-afbb-7031b82f4973 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:59.050403 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-ba19d0e7-cdb8-47ae-a7d8-5512e502c186 req-eaae1357-6c34-4071-afbb-7031b82f4973 service nova] Creating event network-changed:aaf3fae1-693c-4fec-8e06-dc30896dc3f7 for instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79 on hv-cinder-83754 Jun 16 18:15:59.057234 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-ba19d0e7-cdb8-47ae-a7d8-5512e502c186 req-eaae1357-6c34-4071-afbb-7031b82f4973 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046859 Jun 16 18:15:59.058177 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 459/915] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:59.063521 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-53156f74-4c5f-4f65-b6cb-002cd3500f38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:59.064220 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-53156f74-4c5f-4f65-b6cb-002cd3500f38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:59.071333 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-53156f74-4c5f-4f65-b6cb-002cd3500f38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:59.072099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-53156f74-4c5f-4f65-b6cb-002cd3500f38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:59.073294 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-53156f74-4c5f-4f65-b6cb-002cd3500f38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:59.074005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-53156f74-4c5f-4f65-b6cb-002cd3500f38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:59.357260 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-53156f74-4c5f-4f65-b6cb-002cd3500f38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:59.359893 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4ea9af96-2a9b-4dd9-b0c1-ab450c4bc87b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "POST /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.296658 Jun 16 18:15:59.368508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 457/916] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:15:58 2022] POST /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments => generated 194 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:15:59.380029 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-53156f74-4c5f-4f65-b6cb-002cd3500f38 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.320686 Jun 16 18:15:59.380186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-45417552-5a80-4846-bc1a-a8f4168cac9c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:15:59.380636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 460/917] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:15:59 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:15:59.392259 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-45417552-5a80-4846-bc1a-a8f4168cac9c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:15:59.403124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-45417552-5a80-4846-bc1a-a8f4168cac9c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:59.411756 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-45417552-5a80-4846-bc1a-a8f4168cac9c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:59.414183 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-45417552-5a80-4846-bc1a-a8f4168cac9c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:15:59.415493 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-45417552-5a80-4846-bc1a-a8f4168cac9c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:15:59.677672 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-45417552-5a80-4846-bc1a-a8f4168cac9c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:59.705786 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-45417552-5a80-4846-bc1a-a8f4168cac9c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:59.707241 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-45417552-5a80-4846-bc1a-a8f4168cac9c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:15:59.710097 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-45417552-5a80-4846-bc1a-a8f4168cac9c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.343812 Jun 16 18:15:59.726921 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 458/918] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:15:59 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:00.411580 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2ceb7b51-42f1-4e8d-8fba-e3bff7796749 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:00.413565 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2ceb7b51-42f1-4e8d-8fba-e3bff7796749 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:00.421859 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2ceb7b51-42f1-4e8d-8fba-e3bff7796749 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:00.422959 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2ceb7b51-42f1-4e8d-8fba-e3bff7796749 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:00.424163 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2ceb7b51-42f1-4e8d-8fba-e3bff7796749 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:00.424888 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2ceb7b51-42f1-4e8d-8fba-e3bff7796749 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:00.702428 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2ceb7b51-42f1-4e8d-8fba-e3bff7796749 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:00.711564 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2ceb7b51-42f1-4e8d-8fba-e3bff7796749 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1568 microversion: 2.1 time: 0.311427 Jun 16 18:16:00.712141 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 461/919] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:00 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1568 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:16:00.740158 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f12f0747-fbd2-488e-b27e-e6d2733183ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:00.742227 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f12f0747-fbd2-488e-b27e-e6d2733183ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:00.752655 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f12f0747-fbd2-488e-b27e-e6d2733183ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:00.753621 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f12f0747-fbd2-488e-b27e-e6d2733183ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:00.755056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f12f0747-fbd2-488e-b27e-e6d2733183ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:00.755963 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f12f0747-fbd2-488e-b27e-e6d2733183ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:01.103772 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f12f0747-fbd2-488e-b27e-e6d2733183ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:01.116641 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f12f0747-fbd2-488e-b27e-e6d2733183ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:01.118404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f12f0747-fbd2-488e-b27e-e6d2733183ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:01.119576 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f12f0747-fbd2-488e-b27e-e6d2733183ba tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.383614 Jun 16 18:16:01.120133 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 459/920] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:00 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:01.730569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-47d0c364-ddb8-4576-a02b-0a8dc15cbc72 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:01.731504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-47d0c364-ddb8-4576-a02b-0a8dc15cbc72 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:01.738692 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-47d0c364-ddb8-4576-a02b-0a8dc15cbc72 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:01.739154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-47d0c364-ddb8-4576-a02b-0a8dc15cbc72 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:01.739964 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-47d0c364-ddb8-4576-a02b-0a8dc15cbc72 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:01.740416 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-47d0c364-ddb8-4576-a02b-0a8dc15cbc72 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:01.796700 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-97c21c06-0039-459b-84a2-c1973990a44c req-1dfe009c-d716-47f5-993b-d1f7a0259b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6c9426-2d6f-4dfb-8bc8-959827d8cf79", "name": "network-vif-deleted", "tag": "aaf3fae1-693c-4fec-8e06-dc30896dc3f7"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:16:01.799545 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=38 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:16:01.805033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-97c21c06-0039-459b-84a2-c1973990a44c req-1dfe009c-d716-47f5-993b-d1f7a0259b8e service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:01.805477 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-97c21c06-0039-459b-84a2-c1973990a44c req-1dfe009c-d716-47f5-993b-d1f7a0259b8e service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:01.817549 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-97c21c06-0039-459b-84a2-c1973990a44c req-1dfe009c-d716-47f5-993b-d1f7a0259b8e service nova] Creating event network-vif-deleted:aaf3fae1-693c-4fec-8e06-dc30896dc3f7 for instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79 on hv-cinder-83754 Jun 16 18:16:01.823491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-97c21c06-0039-459b-84a2-c1973990a44c req-1dfe009c-d716-47f5-993b-d1f7a0259b8e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031880 Jun 16 18:16:01.824267 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 460/921] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:16:01.832761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-47d0c364-ddb8-4576-a02b-0a8dc15cbc72 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:01.842207 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-47d0c364-ddb8-4576-a02b-0a8dc15cbc72 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1501 microversion: 2.1 time: 0.115380 Jun 16 18:16:01.842775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 462/922] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:01 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1501 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:16:02.144287 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-bb907d05-99ce-4f52-8df2-df119b7260cc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:02.145314 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-bb907d05-99ce-4f52-8df2-df119b7260cc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:02.158346 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bb907d05-99ce-4f52-8df2-df119b7260cc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:02.164153 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bb907d05-99ce-4f52-8df2-df119b7260cc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:02.164153 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bb907d05-99ce-4f52-8df2-df119b7260cc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:02.164153 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bb907d05-99ce-4f52-8df2-df119b7260cc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:02.352530 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-bb907d05-99ce-4f52-8df2-df119b7260cc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:02.367559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-bb907d05-99ce-4f52-8df2-df119b7260cc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:02.367559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-bb907d05-99ce-4f52-8df2-df119b7260cc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:02.367559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-bb907d05-99ce-4f52-8df2-df119b7260cc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.228877 Jun 16 18:16:02.379349 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 461/923] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:02 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:02.865849 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-498b22ac-f2f8-491d-8083-54fb670ed829 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:02.867102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-498b22ac-f2f8-491d-8083-54fb670ed829 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:02.878848 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-498b22ac-f2f8-491d-8083-54fb670ed829 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:02.879687 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-498b22ac-f2f8-491d-8083-54fb670ed829 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:02.880934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-498b22ac-f2f8-491d-8083-54fb670ed829 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:02.881639 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-498b22ac-f2f8-491d-8083-54fb670ed829 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:03.008103 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-498b22ac-f2f8-491d-8083-54fb670ed829 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:03.024584 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-498b22ac-f2f8-491d-8083-54fb670ed829 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1501 microversion: 2.1 time: 0.166642 Jun 16 18:16:03.041951 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 463/924] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:02 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:16:03.387530 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0fff6b1c-4c3b-4b38-ba37-952e94c2a228 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:03.388918 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0fff6b1c-4c3b-4b38-ba37-952e94c2a228 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:03.396545 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0fff6b1c-4c3b-4b38-ba37-952e94c2a228 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:03.398106 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0fff6b1c-4c3b-4b38-ba37-952e94c2a228 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:03.398926 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0fff6b1c-4c3b-4b38-ba37-952e94c2a228 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:03.399393 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0fff6b1c-4c3b-4b38-ba37-952e94c2a228 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:03.580838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0fff6b1c-4c3b-4b38-ba37-952e94c2a228 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:03.589964 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0fff6b1c-4c3b-4b38-ba37-952e94c2a228 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:03.591507 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0fff6b1c-4c3b-4b38-ba37-952e94c2a228 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:03.593007 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0fff6b1c-4c3b-4b38-ba37-952e94c2a228 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.209778 Jun 16 18:16:03.593562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 462/925] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:03 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:04.058418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1d33c3af-0db7-4e30-a76d-a7dded308d6d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:04.059393 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1d33c3af-0db7-4e30-a76d-a7dded308d6d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:04.072687 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1d33c3af-0db7-4e30-a76d-a7dded308d6d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:04.073745 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1d33c3af-0db7-4e30-a76d-a7dded308d6d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:04.075142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1d33c3af-0db7-4e30-a76d-a7dded308d6d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:04.076102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1d33c3af-0db7-4e30-a76d-a7dded308d6d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:04.206511 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1d33c3af-0db7-4e30-a76d-a7dded308d6d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:04.220511 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1d33c3af-0db7-4e30-a76d-a7dded308d6d tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1382 microversion: 2.1 time: 0.169494 Jun 16 18:16:04.232251 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 464/926] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:04 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1382 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:16:04.619880 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d6ea1736-81f3-4033-9312-698355da2434 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:04.621542 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d6ea1736-81f3-4033-9312-698355da2434 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:04.629683 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d6ea1736-81f3-4033-9312-698355da2434 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:04.630142 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d6ea1736-81f3-4033-9312-698355da2434 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:04.631093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d6ea1736-81f3-4033-9312-698355da2434 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:04.631485 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d6ea1736-81f3-4033-9312-698355da2434 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:04.898961 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d6ea1736-81f3-4033-9312-698355da2434 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:04.916282 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d6ea1736-81f3-4033-9312-698355da2434 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:04.919793 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d6ea1736-81f3-4033-9312-698355da2434 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:04.923292 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d6ea1736-81f3-4033-9312-698355da2434 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.307916 Jun 16 18:16:04.927238 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 463/927] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:04 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:05.243626 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5d05b9ad-281e-40db-ad3d-e882fc903924 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:05.244471 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5d05b9ad-281e-40db-ad3d-e882fc903924 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:05.254543 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d05b9ad-281e-40db-ad3d-e882fc903924 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:05.257655 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d05b9ad-281e-40db-ad3d-e882fc903924 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:05.262230 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d05b9ad-281e-40db-ad3d-e882fc903924 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:05.263120 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5d05b9ad-281e-40db-ad3d-e882fc903924 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:05.341614 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-5d05b9ad-281e-40db-ad3d-e882fc903924 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:05.355227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5d05b9ad-281e-40db-ad3d-e882fc903924 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1219 microversion: 2.1 time: 0.116086 Jun 16 18:16:05.356611 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 465/928] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:05 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:16:05.953960 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-09b5c1aa-5acc-4654-9b08-8bf32daa5cd4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:05.954736 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-09b5c1aa-5acc-4654-9b08-8bf32daa5cd4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:05.961615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-09b5c1aa-5acc-4654-9b08-8bf32daa5cd4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:05.962060 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-09b5c1aa-5acc-4654-9b08-8bf32daa5cd4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:05.962829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-09b5c1aa-5acc-4654-9b08-8bf32daa5cd4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:05.963264 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-09b5c1aa-5acc-4654-9b08-8bf32daa5cd4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:06.147545 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-09b5c1aa-5acc-4654-9b08-8bf32daa5cd4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:06.178212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-09b5c1aa-5acc-4654-9b08-8bf32daa5cd4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:06.181157 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-09b5c1aa-5acc-4654-9b08-8bf32daa5cd4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:06.187132 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-09b5c1aa-5acc-4654-9b08-8bf32daa5cd4 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.237062 Jun 16 18:16:06.200391 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 464/929] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:05 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:06.392702 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f6add25a-c237-4aa6-af8a-c0d296d97dcd tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:06.395221 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f6add25a-c237-4aa6-af8a-c0d296d97dcd tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:06.406068 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f6add25a-c237-4aa6-af8a-c0d296d97dcd tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:06.406843 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f6add25a-c237-4aa6-af8a-c0d296d97dcd tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:06.409110 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f6add25a-c237-4aa6-af8a-c0d296d97dcd tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:06.413277 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f6add25a-c237-4aa6-af8a-c0d296d97dcd tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:06.561887 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f6add25a-c237-4aa6-af8a-c0d296d97dcd tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2311f0b1e7074500a6964504a7aee218', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb225966010445785ba6d65c068176c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:06.572701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f6add25a-c237-4aa6-af8a-c0d296d97dcd tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 200 len: 1219 microversion: 2.1 time: 0.197414 Jun 16 18:16:06.573518 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 466/930] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:06 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 1219 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:16:07.211751 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-31652303-20fc-42c0-a2df-4d8d400e20c9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:07.212678 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-31652303-20fc-42c0-a2df-4d8d400e20c9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:07.220101 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-31652303-20fc-42c0-a2df-4d8d400e20c9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:07.220540 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-31652303-20fc-42c0-a2df-4d8d400e20c9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:07.221510 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-31652303-20fc-42c0-a2df-4d8d400e20c9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:07.221947 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-31652303-20fc-42c0-a2df-4d8d400e20c9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:07.380096 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-31652303-20fc-42c0-a2df-4d8d400e20c9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:07.396672 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-31652303-20fc-42c0-a2df-4d8d400e20c9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:07.399337 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-31652303-20fc-42c0-a2df-4d8d400e20c9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:07.400667 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-31652303-20fc-42c0-a2df-4d8d400e20c9 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.196197 Jun 16 18:16:07.401466 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 465/931] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:07 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:07.602399 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e9c06662-9170-4249-ae5e-103f06079060 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:07.603125 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e9c06662-9170-4249-ae5e-103f06079060 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] [instance: df6c9426-2d6f-4dfb-8bc8-959827d8cf79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:07.609605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e9c06662-9170-4249-ae5e-103f06079060 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:07.610052 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e9c06662-9170-4249-ae5e-103f06079060 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:07.610820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e9c06662-9170-4249-ae5e-103f06079060 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:07.611246 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e9c06662-9170-4249-ae5e-103f06079060 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:07.626662 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-e9c06662-9170-4249-ae5e-103f06079060 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] HTTP exception thrown: Instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79 could not be found. Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e9c06662-9170-4249-ae5e-103f06079060 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Request method failure captured: Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 HTTP/1.1 Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3HXCrUGkXCUHOrA7Rqbe3aRC9a7d7lScYHMo6ApK-tNj0UeU_5sZoGuvJADfrqq7OjrPqfEhhQXYANcilEQjrfAmlwLdxbOEJIStkNyz-YYDhOqSbxIsY1uhp80dcMN1dR36Er5rpvBFtCbvkRs2d4jODRbIMgziwLqk0ASdYRLmdo Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: bdb225966010445785ba6d65c068176c Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-TestShelveInstance-1082123555 Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:16:07.628569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:16:07.630761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bdb225966010445785ba6d65c068176c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bdb225966010445785ba6d65c068176c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bdb225966010445785ba6d65c068176c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bdb225966010445785ba6d65c068176c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:16:07.630761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-TestShelveInstance-1082123555 Jun 16 18:16:07.630761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: bdb225966010445785ba6d65c068176c Jun 16 18:16:07.630761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-TestShelveInstance-1082123555 Jun 16 18:16:07.630761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-TestShelveInstance-1082123555-project Jun 16 18:16:07.630761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:16:07.630761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:16:07.630761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 2311f0b1e7074500a6964504a7aee218 Jun 16 18:16:07.630761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-TestShelveInstance-1082123555-project Jun 16 18:16:07.630761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:16:07.630761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79 could not be found. Jun 16 18:16:07.630761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': 'df6c9426-2d6f-4dfb-8bc8-959827d8cf79'} Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79 could not be found. Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:16:07.631810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79 could not be found. Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79 could not be found. Jun 16 18:16:07.635113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:07.637364 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e9c06662-9170-4249-ae5e-103f06079060 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Returning 404 to user: Instance df6c9426-2d6f-4dfb-8bc8-959827d8cf79 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:16:07.637364 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e9c06662-9170-4249-ae5e-103f06079060 tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79" status: 404 len: 111 microversion: 2.1 time: 0.031612 Jun 16 18:16:07.637364 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 467/932] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:07 2022] GET /compute/v2.1/servers/df6c9426-2d6f-4dfb-8bc8-959827d8cf79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:16:07.953831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-7d32b468-6bee-461c-9d49-94cc20a2850f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] Calling method '.version_select at 0x7f9c23b11940>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:08.036775 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-7d32b468-6bee-461c-9d49-94cc20a2850f tempest-TestShelveInstance-1082123555 tempest-TestShelveInstance-1082123555-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1852837450" status: 202 len: 0 microversion: 2.1 time: 0.087402 Jun 16 18:16:08.037750 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 466/933] 10.222.0.58 () {58 vars in 1253 bytes} [Thu Jun 16 18:16:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1852837450 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:16:08.422706 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d1e60413-b84c-49bc-9bfe-70521fc986af tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:08.423640 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d1e60413-b84c-49bc-9bfe-70521fc986af tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:08.431299 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d1e60413-b84c-49bc-9bfe-70521fc986af tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:08.431784 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d1e60413-b84c-49bc-9bfe-70521fc986af tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:08.432577 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d1e60413-b84c-49bc-9bfe-70521fc986af tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:08.433014 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d1e60413-b84c-49bc-9bfe-70521fc986af tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:08.602708 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d1e60413-b84c-49bc-9bfe-70521fc986af tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:08.616213 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d1e60413-b84c-49bc-9bfe-70521fc986af tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:08.619042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d1e60413-b84c-49bc-9bfe-70521fc986af tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:08.621028 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d1e60413-b84c-49bc-9bfe-70521fc986af tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.202530 Jun 16 18:16:08.621971 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 468/934] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:08 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:09.652227 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c91e2949-4280-4815-abb3-2d0d20eaca66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:09.653236 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c91e2949-4280-4815-abb3-2d0d20eaca66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:09.666753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c91e2949-4280-4815-abb3-2d0d20eaca66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:09.667938 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c91e2949-4280-4815-abb3-2d0d20eaca66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:09.669427 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c91e2949-4280-4815-abb3-2d0d20eaca66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:09.670085 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c91e2949-4280-4815-abb3-2d0d20eaca66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:09.877563 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c91e2949-4280-4815-abb3-2d0d20eaca66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:09.896999 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c91e2949-4280-4815-abb3-2d0d20eaca66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:09.898956 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c91e2949-4280-4815-abb3-2d0d20eaca66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:09.900188 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c91e2949-4280-4815-abb3-2d0d20eaca66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.255306 Jun 16 18:16:09.900813 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 467/935] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:09 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:10.919815 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9b9ca831-3c47-4bb4-99d8-a5cafcb9ffca tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:10.920740 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9b9ca831-3c47-4bb4-99d8-a5cafcb9ffca tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:10.929542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9b9ca831-3c47-4bb4-99d8-a5cafcb9ffca tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:10.933523 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9b9ca831-3c47-4bb4-99d8-a5cafcb9ffca tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:10.933523 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9b9ca831-3c47-4bb4-99d8-a5cafcb9ffca tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:10.933523 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9b9ca831-3c47-4bb4-99d8-a5cafcb9ffca tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:11.120823 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9b9ca831-3c47-4bb4-99d8-a5cafcb9ffca tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:11.136692 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9b9ca831-3c47-4bb4-99d8-a5cafcb9ffca tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:11.138233 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9b9ca831-3c47-4bb4-99d8-a5cafcb9ffca tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:11.140112 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9b9ca831-3c47-4bb4-99d8-a5cafcb9ffca tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.223884 Jun 16 18:16:11.141038 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 469/936] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:10 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:12.171191 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-07902019-a6b9-430a-8e8b-b2b5e0832472 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:12.171975 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-07902019-a6b9-430a-8e8b-b2b5e0832472 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:12.179493 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-07902019-a6b9-430a-8e8b-b2b5e0832472 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:12.180880 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-07902019-a6b9-430a-8e8b-b2b5e0832472 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:12.182165 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-07902019-a6b9-430a-8e8b-b2b5e0832472 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:12.182918 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-07902019-a6b9-430a-8e8b-b2b5e0832472 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:12.718846 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-07902019-a6b9-430a-8e8b-b2b5e0832472 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:12.732259 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-07902019-a6b9-430a-8e8b-b2b5e0832472 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:12.734126 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-07902019-a6b9-430a-8e8b-b2b5e0832472 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:12.735968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-07902019-a6b9-430a-8e8b-b2b5e0832472 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1740 microversion: 2.20 time: 0.569237 Jun 16 18:16:12.736780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 468/937] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:12 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1740 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:16:13.761387 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1d850f12-9a1a-4709-a4b2-d9c3c68b71bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:13.763857 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1d850f12-9a1a-4709-a4b2-d9c3c68b71bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:13.772986 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1d850f12-9a1a-4709-a4b2-d9c3c68b71bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:13.773445 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1d850f12-9a1a-4709-a4b2-d9c3c68b71bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:13.774238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1d850f12-9a1a-4709-a4b2-d9c3c68b71bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:13.774677 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1d850f12-9a1a-4709-a4b2-d9c3c68b71bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:13.946555 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1d850f12-9a1a-4709-a4b2-d9c3c68b71bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:13.955285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1d850f12-9a1a-4709-a4b2-d9c3c68b71bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:13.956855 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1d850f12-9a1a-4709-a4b2-d9c3c68b71bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:13.958085 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1d850f12-9a1a-4709-a4b2-d9c3c68b71bb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1722 microversion: 2.20 time: 0.204647 Jun 16 18:16:13.959667 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 470/938] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:13 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:14.982362 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c3b0a471-8e4d-40e8-8584-53cdd0936529 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:14.983193 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c3b0a471-8e4d-40e8-8584-53cdd0936529 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:14.991721 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-4231694a-cf1a-4f1f-9114-5ba32f539abf req-1c4c9500-3ce0-4ff7-8e04-33a4ab2ef8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4792d5b1-2139-4dc1-b191-7975b01fc093", "name": "network-vif-unplugged", "status": "completed", "tag": "7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:16:14.999464 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c3b0a471-8e4d-40e8-8584-53cdd0936529 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:14.999985 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c3b0a471-8e4d-40e8-8584-53cdd0936529 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:15.001788 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c3b0a471-8e4d-40e8-8584-53cdd0936529 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:15.002517 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c3b0a471-8e4d-40e8-8584-53cdd0936529 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:15.010256 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-4231694a-cf1a-4f1f-9114-5ba32f539abf req-1c4c9500-3ce0-4ff7-8e04-33a4ab2ef8d9 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:15.013379 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-4231694a-cf1a-4f1f-9114-5ba32f539abf req-1c4c9500-3ce0-4ff7-8e04-33a4ab2ef8d9 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:15.034855 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-4231694a-cf1a-4f1f-9114-5ba32f539abf req-1c4c9500-3ce0-4ff7-8e04-33a4ab2ef8d9 service nova] Creating event network-vif-unplugged:7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e for instance 4792d5b1-2139-4dc1-b191-7975b01fc093 on hv-cinder-83754 Jun 16 18:16:15.046872 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-4231694a-cf1a-4f1f-9114-5ba32f539abf req-1c4c9500-3ce0-4ff7-8e04-33a4ab2ef8d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065711 Jun 16 18:16:15.048564 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 471/939] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:16:15.223064 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c3b0a471-8e4d-40e8-8584-53cdd0936529 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:15.233977 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c3b0a471-8e4d-40e8-8584-53cdd0936529 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:15.235541 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c3b0a471-8e4d-40e8-8584-53cdd0936529 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:15.236710 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c3b0a471-8e4d-40e8-8584-53cdd0936529 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1722 microversion: 2.20 time: 0.262677 Jun 16 18:16:15.237271 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 469/940] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:14 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:15.722086 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e10f1d00-3ebb-41ba-bb71-4be5fcfbe5cc tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:15.723851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e10f1d00-3ebb-41ba-bb71-4be5fcfbe5cc tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:15.733068 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e10f1d00-3ebb-41ba-bb71-4be5fcfbe5cc tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:15.733491 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e10f1d00-3ebb-41ba-bb71-4be5fcfbe5cc tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:15.734377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e10f1d00-3ebb-41ba-bb71-4be5fcfbe5cc tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:15.734726 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e10f1d00-3ebb-41ba-bb71-4be5fcfbe5cc tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:15.769262 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e10f1d00-3ebb-41ba-bb71-4be5fcfbe5cc tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054799 Jun 16 18:16:15.772061 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 472/941] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:16:15 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:16:15.922661 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d56d9763-c7c2-442f-be79-df269624eedf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:15.925624 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d56d9763-c7c2-442f-be79-df269624eedf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:15.935785 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d56d9763-c7c2-442f-be79-df269624eedf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:15.936553 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d56d9763-c7c2-442f-be79-df269624eedf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:15.937726 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d56d9763-c7c2-442f-be79-df269624eedf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:15.938679 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d56d9763-c7c2-442f-be79-df269624eedf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:15.998596 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d56d9763-c7c2-442f-be79-df269624eedf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments/dbd0d343-4081-4728-8ae2-8914eb36cf1f" status: 200 len: 194 microversion: 2.1 time: 0.082726 Jun 16 18:16:16.005604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 470/942] 10.222.0.58 () {58 vars in 1412 bytes} [Thu Jun 16 18:16:15 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments/dbd0d343-4081-4728-8ae2-8914eb36cf1f => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:16:16.015060 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d62d63cf-be2d-47d2-b1c6-70578ea91268 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:16.018701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d62d63cf-be2d-47d2-b1c6-70578ea91268 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:16.027322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d62d63cf-be2d-47d2-b1c6-70578ea91268 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:16.027322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d62d63cf-be2d-47d2-b1c6-70578ea91268 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:16.027929 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d62d63cf-be2d-47d2-b1c6-70578ea91268 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:16.028567 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d62d63cf-be2d-47d2-b1c6-70578ea91268 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:16.131949 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:16:16.138698 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-d62d63cf-be2d-47d2-b1c6-70578ea91268 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lazy-loading 'services' on Instance uuid 8ceb78ff-a348-4800-9bec-517f2cccc8c3 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:16:16.260615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-42abc5db-7e37-4c31-8cda-9235845b2f82 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:16.261366 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-42abc5db-7e37-4c31-8cda-9235845b2f82 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:16.268817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-42abc5db-7e37-4c31-8cda-9235845b2f82 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:16.276012 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-42abc5db-7e37-4c31-8cda-9235845b2f82 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:16.276012 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-42abc5db-7e37-4c31-8cda-9235845b2f82 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:16.276012 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-42abc5db-7e37-4c31-8cda-9235845b2f82 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:16.478083 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-42abc5db-7e37-4c31-8cda-9235845b2f82 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:16.494262 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-42abc5db-7e37-4c31-8cda-9235845b2f82 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:16.498052 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-42abc5db-7e37-4c31-8cda-9235845b2f82 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:16.500276 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-42abc5db-7e37-4c31-8cda-9235845b2f82 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1722 microversion: 2.20 time: 0.247005 Jun 16 18:16:16.502982 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 471/943] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:16 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:16:16.550560 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d62d63cf-be2d-47d2-b1c6-70578ea91268 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments/dbd0d343-4081-4728-8ae2-8914eb36cf1f" status: 202 len: 0 microversion: 2.1 time: 0.539178 Jun 16 18:16:16.551170 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 473/944] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jun 16 18:16:16 2022] DELETE /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments/dbd0d343-4081-4728-8ae2-8914eb36cf1f => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:16:17.520852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b736576d-1554-4585-aaaa-56691d25aefc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:17.521754 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b736576d-1554-4585-aaaa-56691d25aefc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:17.528898 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b736576d-1554-4585-aaaa-56691d25aefc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:17.529551 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b736576d-1554-4585-aaaa-56691d25aefc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:17.530594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b736576d-1554-4585-aaaa-56691d25aefc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:17.531144 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b736576d-1554-4585-aaaa-56691d25aefc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:17.783610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b736576d-1554-4585-aaaa-56691d25aefc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:17.793391 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b736576d-1554-4585-aaaa-56691d25aefc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:17.795168 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b736576d-1554-4585-aaaa-56691d25aefc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:17.796465 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b736576d-1554-4585-aaaa-56691d25aefc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1722 microversion: 2.20 time: 0.279749 Jun 16 18:16:17.797332 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 472/945] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:17 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:18.818730 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3d4e9e14-045b-41ea-9c0e-5f4c396a9728 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:18.820054 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3d4e9e14-045b-41ea-9c0e-5f4c396a9728 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:18.832775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3d4e9e14-045b-41ea-9c0e-5f4c396a9728 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:18.833660 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3d4e9e14-045b-41ea-9c0e-5f4c396a9728 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:18.836147 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3d4e9e14-045b-41ea-9c0e-5f4c396a9728 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:18.837016 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3d4e9e14-045b-41ea-9c0e-5f4c396a9728 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:19.049636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3d4e9e14-045b-41ea-9c0e-5f4c396a9728 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:19.091660 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3d4e9e14-045b-41ea-9c0e-5f4c396a9728 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:19.091660 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3d4e9e14-045b-41ea-9c0e-5f4c396a9728 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:19.091660 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3d4e9e14-045b-41ea-9c0e-5f4c396a9728 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1725 microversion: 2.20 time: 0.274032 Jun 16 18:16:19.094564 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 474/946] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:18 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1725 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:19.121597 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d859d913-1c50-4deb-bf84-a04bef705a36 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee48f78a-424d-4614-a665-07fd7287b507"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:16:19.123411 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d859d913-1c50-4deb-bf84-a04bef705a36 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:19.134774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d859d913-1c50-4deb-bf84-a04bef705a36 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:19.135423 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d859d913-1c50-4deb-bf84-a04bef705a36 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:19.136269 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d859d913-1c50-4deb-bf84-a04bef705a36 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:19.136744 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d859d913-1c50-4deb-bf84-a04bef705a36 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:19.955894 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1ae76bb5-6edc-42da-83e7-83f069c31b06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:19.956851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1ae76bb5-6edc-42da-83e7-83f069c31b06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:19.968097 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1ae76bb5-6edc-42da-83e7-83f069c31b06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:19.968097 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1ae76bb5-6edc-42da-83e7-83f069c31b06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:19.968097 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1ae76bb5-6edc-42da-83e7-83f069c31b06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:19.968097 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1ae76bb5-6edc-42da-83e7-83f069c31b06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:20.010424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1ae76bb5-6edc-42da-83e7-83f069c31b06 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments/165dae85-965e-4d4c-91a6-a2c34c999abe" status: 200 len: 194 microversion: 2.1 time: 0.060061 Jun 16 18:16:20.010815 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 475/947] 10.222.0.58 () {58 vars in 1412 bytes} [Thu Jun 16 18:16:19 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments/165dae85-965e-4d4c-91a6-a2c34c999abe => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:16:20.022984 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3f11d170-fd64-4c98-94c4-ab7a9dda1e6e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:20.023827 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3f11d170-fd64-4c98-94c4-ab7a9dda1e6e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:20.031427 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3f11d170-fd64-4c98-94c4-ab7a9dda1e6e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:20.031940 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3f11d170-fd64-4c98-94c4-ab7a9dda1e6e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:20.032906 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3f11d170-fd64-4c98-94c4-ab7a9dda1e6e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:20.033412 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3f11d170-fd64-4c98-94c4-ab7a9dda1e6e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:20.127514 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:16:20.171987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-3f11d170-fd64-4c98-94c4-ab7a9dda1e6e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lazy-loading 'services' on Instance uuid 8ceb78ff-a348-4800-9bec-517f2cccc8c3 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:16:20.617095 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3f11d170-fd64-4c98-94c4-ab7a9dda1e6e tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments/165dae85-965e-4d4c-91a6-a2c34c999abe" status: 202 len: 0 microversion: 2.1 time: 0.599484 Jun 16 18:16:20.617736 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 476/948] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jun 16 18:16:20 2022] DELETE /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments/165dae85-965e-4d4c-91a6-a2c34c999abe => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:16:21.143287 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d859d913-1c50-4deb-bf84-a04bef705a36 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "POST /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.029858 Jun 16 18:16:21.144316 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 473/949] 10.222.0.58 () {62 vars in 1363 bytes} [Thu Jun 16 18:16:19 2022] POST /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/os-volume_attachments => generated 188 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:16:21.290421 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-62673d3f-f029-483d-968e-ce6c0a18a221 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:21.291020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-62673d3f-f029-483d-968e-ce6c0a18a221 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:21.298098 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-62673d3f-f029-483d-968e-ce6c0a18a221 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:21.298494 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-62673d3f-f029-483d-968e-ce6c0a18a221 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:21.299287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-62673d3f-f029-483d-968e-ce6c0a18a221 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:21.299755 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-62673d3f-f029-483d-968e-ce6c0a18a221 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:25.092276 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-62673d3f-f029-483d-968e-ce6c0a18a221 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/os-volume_attachments/ee48f78a-424d-4614-a665-07fd7287b507" status: 202 len: 0 microversion: 2.20 time: 3.807901 Jun 16 18:16:25.093348 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 477/950] 10.222.0.58 () {60 vars in 1456 bytes} [Thu Jun 16 18:16:21 2022] DELETE /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/os-volume_attachments/ee48f78a-424d-4614-a665-07fd7287b507 => generated 0 bytes in 3811 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:16:25.158508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6d8ea048-4211-4e8e-ad64-f228522fc49f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:16:25.162653 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6d8ea048-4211-4e8e-ad64-f228522fc49f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:25.168585 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6d8ea048-4211-4e8e-ad64-f228522fc49f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:25.169046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6d8ea048-4211-4e8e-ad64-f228522fc49f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:25.169933 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6d8ea048-4211-4e8e-ad64-f228522fc49f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:25.170375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6d8ea048-4211-4e8e-ad64-f228522fc49f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:25.473596 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d8ea048-4211-4e8e-ad64-f228522fc49f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [c4deccb2-ca80-4d5a-befb-a3836be936ae] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 18:16:26.153126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-aaf62dcd-36b1-4737-852e-ec0939eb55e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:26.157500 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-aaf62dcd-36b1-4737-852e-ec0939eb55e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:26.172378 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aaf62dcd-36b1-4737-852e-ec0939eb55e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:26.174887 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aaf62dcd-36b1-4737-852e-ec0939eb55e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:26.176062 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aaf62dcd-36b1-4737-852e-ec0939eb55e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:26.176836 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aaf62dcd-36b1-4737-852e-ec0939eb55e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:26.234001 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-aaf62dcd-36b1-4737-852e-ec0939eb55e9 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090379 Jun 16 18:16:26.234738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 478/951] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:16:26 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:16:26.406287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b75da453-5366-445f-b4e2-ff5f4ebd1544 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:26.407767 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b75da453-5366-445f-b4e2-ff5f4ebd1544 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:26.414749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b75da453-5366-445f-b4e2-ff5f4ebd1544 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:26.415195 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b75da453-5366-445f-b4e2-ff5f4ebd1544 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:26.416076 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b75da453-5366-445f-b4e2-ff5f4ebd1544 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:26.416455 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b75da453-5366-445f-b4e2-ff5f4ebd1544 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:26.449475 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b75da453-5366-445f-b4e2-ff5f4ebd1544 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047456 Jun 16 18:16:26.449964 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 479/952] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:16:26 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:16:26.483120 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d8ea048-4211-4e8e-ad64-f228522fc49f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [c4deccb2-ca80-4d5a-befb-a3836be936ae] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 49756. Jun 16 18:16:26.486561 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6d8ea048-4211-4e8e-ad64-f228522fc49f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "POST /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/action" status: 202 len: 0 microversion: 2.20 time: 1.332649 Jun 16 18:16:26.487902 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 474/953] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Jun 16 18:16:25 2022] POST /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/action => generated 0 bytes in 1334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:16:26.506564 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ed0ceecf-3e7f-464e-bbf5-5ddd624dfbe5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:26.506564 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ed0ceecf-3e7f-464e-bbf5-5ddd624dfbe5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:26.532925 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ed0ceecf-3e7f-464e-bbf5-5ddd624dfbe5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:26.533730 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ed0ceecf-3e7f-464e-bbf5-5ddd624dfbe5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:26.534639 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ed0ceecf-3e7f-464e-bbf5-5ddd624dfbe5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:26.535152 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ed0ceecf-3e7f-464e-bbf5-5ddd624dfbe5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:26.561714 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c6cc979e-0914-482b-a2fb-29ed9567b756 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:26.562508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c6cc979e-0914-482b-a2fb-29ed9567b756 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:26.570369 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c6cc979e-0914-482b-a2fb-29ed9567b756 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:26.571077 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c6cc979e-0914-482b-a2fb-29ed9567b756 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:26.572052 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c6cc979e-0914-482b-a2fb-29ed9567b756 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:26.572671 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c6cc979e-0914-482b-a2fb-29ed9567b756 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:26.612376 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c6cc979e-0914-482b-a2fb-29ed9567b756 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Going to try to terminate instance {{(pid=118162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:16:26.964091 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ed0ceecf-3e7f-464e-bbf5-5ddd624dfbe5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:26.973068 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ed0ceecf-3e7f-464e-bbf5-5ddd624dfbe5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:26.976236 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ed0ceecf-3e7f-464e-bbf5-5ddd624dfbe5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:26.976708 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ed0ceecf-3e7f-464e-bbf5-5ddd624dfbe5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1673 microversion: 2.20 time: 0.479456 Jun 16 18:16:26.977274 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 480/954] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:26 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1673 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:27.218428 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c6cc979e-0914-482b-a2fb-29ed9567b756 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 204 len: 0 microversion: 2.1 time: 0.658764 Jun 16 18:16:27.221298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 475/955] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:16:26 2022] DELETE /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:16:27.242084 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ce7cb9a1-74d0-4044-aa61-fe16f860b56b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:27.244141 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ce7cb9a1-74d0-4044-aa61-fe16f860b56b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:27.275640 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce7cb9a1-74d0-4044-aa61-fe16f860b56b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:27.276783 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce7cb9a1-74d0-4044-aa61-fe16f860b56b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:27.277148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce7cb9a1-74d0-4044-aa61-fe16f860b56b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:27.277655 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce7cb9a1-74d0-4044-aa61-fe16f860b56b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:27.548518 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ce7cb9a1-74d0-4044-aa61-fe16f860b56b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:27.555153 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ce7cb9a1-74d0-4044-aa61-fe16f860b56b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1673 microversion: 2.1 time: 0.326424 Jun 16 18:16:27.555801 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 481/956] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:27 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1673 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:16:27.997174 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6600118a-a91b-4511-9932-255a90ebb701 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:27.997993 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6600118a-a91b-4511-9932-255a90ebb701 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:28.005472 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6600118a-a91b-4511-9932-255a90ebb701 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:28.006562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6600118a-a91b-4511-9932-255a90ebb701 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:28.007532 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6600118a-a91b-4511-9932-255a90ebb701 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:28.007968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6600118a-a91b-4511-9932-255a90ebb701 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:28.300098 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6600118a-a91b-4511-9932-255a90ebb701 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:28.311712 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6600118a-a91b-4511-9932-255a90ebb701 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:28.314078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6600118a-a91b-4511-9932-255a90ebb701 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:28.316075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6600118a-a91b-4511-9932-255a90ebb701 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1673 microversion: 2.20 time: 0.323475 Jun 16 18:16:28.317509 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 476/957] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:27 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1673 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:28.574844 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a9edd73b-57d4-4eb0-98c7-857e2e9b0b27 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:28.575878 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a9edd73b-57d4-4eb0-98c7-857e2e9b0b27 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:28.578473 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:16:28.584046 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a9edd73b-57d4-4eb0-98c7-857e2e9b0b27 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:28.584746 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a9edd73b-57d4-4eb0-98c7-857e2e9b0b27 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:28.586224 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a9edd73b-57d4-4eb0-98c7-857e2e9b0b27 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:28.587039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a9edd73b-57d4-4eb0-98c7-857e2e9b0b27 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:28.772509 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a9edd73b-57d4-4eb0-98c7-857e2e9b0b27 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:28.776142 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a9edd73b-57d4-4eb0-98c7-857e2e9b0b27 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1673 microversion: 2.1 time: 0.205629 Jun 16 18:16:28.776758 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 482/958] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:28 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:16:29.350447 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-51c73a1e-699f-4115-8b7e-28687dcaf1d8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:29.351822 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-51c73a1e-699f-4115-8b7e-28687dcaf1d8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:29.372638 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-51c73a1e-699f-4115-8b7e-28687dcaf1d8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:29.373089 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-51c73a1e-699f-4115-8b7e-28687dcaf1d8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:29.377089 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-51c73a1e-699f-4115-8b7e-28687dcaf1d8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:29.377721 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-51c73a1e-699f-4115-8b7e-28687dcaf1d8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:29.753828 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-51c73a1e-699f-4115-8b7e-28687dcaf1d8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:29.767048 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-51c73a1e-699f-4115-8b7e-28687dcaf1d8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:29.768594 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-51c73a1e-699f-4115-8b7e-28687dcaf1d8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:29.769784 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-51c73a1e-699f-4115-8b7e-28687dcaf1d8 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1675 microversion: 2.20 time: 0.428340 Jun 16 18:16:29.770335 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 477/959] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:29 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1675 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:29.794462 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ceced30a-e3b9-42ff-9b58-465eda72d691 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:29.795879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ceced30a-e3b9-42ff-9b58-465eda72d691 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:29.803711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ceced30a-e3b9-42ff-9b58-465eda72d691 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:29.804099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ceced30a-e3b9-42ff-9b58-465eda72d691 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:29.805118 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ceced30a-e3b9-42ff-9b58-465eda72d691 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:29.806440 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ceced30a-e3b9-42ff-9b58-465eda72d691 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:30.058289 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ceced30a-e3b9-42ff-9b58-465eda72d691 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:30.075598 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ceced30a-e3b9-42ff-9b58-465eda72d691 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1673 microversion: 2.1 time: 0.284527 Jun 16 18:16:30.087820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 483/960] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:29 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1673 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:16:30.737281 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-c2985907-fe20-422d-ba5b-6f01d0ee23b7 req-80735daf-a544-49b3-a748-66e2cd684dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ceb78ff-a348-4800-9bec-517f2cccc8c3", "name": "network-vif-deleted", "tag": "62c371e1-4b97-4c82-8910-07da309b05e0"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:16:30.748393 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-c2985907-fe20-422d-ba5b-6f01d0ee23b7 req-80735daf-a544-49b3-a748-66e2cd684dba service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:30.749288 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-c2985907-fe20-422d-ba5b-6f01d0ee23b7 req-80735daf-a544-49b3-a748-66e2cd684dba service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:30.766175 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-c2985907-fe20-422d-ba5b-6f01d0ee23b7 req-80735daf-a544-49b3-a748-66e2cd684dba service nova] Creating event network-vif-deleted:62c371e1-4b97-4c82-8910-07da309b05e0 for instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 on hv-cinder-83754 Jun 16 18:16:30.773221 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-c2985907-fe20-422d-ba5b-6f01d0ee23b7 req-80735daf-a544-49b3-a748-66e2cd684dba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042116 Jun 16 18:16:30.774444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 478/961] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:16:30.796432 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-297d408e-8e80-480c-a6b7-71db1f2c3e59 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:30.805213 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-297d408e-8e80-480c-a6b7-71db1f2c3e59 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:30.845912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-297d408e-8e80-480c-a6b7-71db1f2c3e59 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:30.845912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-297d408e-8e80-480c-a6b7-71db1f2c3e59 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:30.845912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-297d408e-8e80-480c-a6b7-71db1f2c3e59 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:30.845912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-297d408e-8e80-480c-a6b7-71db1f2c3e59 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:31.094903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-02217ed5-99f6-4b0b-b54f-0fc9046462eb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:31.095733 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-02217ed5-99f6-4b0b-b54f-0fc9046462eb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:31.113831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-02217ed5-99f6-4b0b-b54f-0fc9046462eb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:31.113831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-02217ed5-99f6-4b0b-b54f-0fc9046462eb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:31.113831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-02217ed5-99f6-4b0b-b54f-0fc9046462eb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:31.113831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-02217ed5-99f6-4b0b-b54f-0fc9046462eb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:31.134933 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-297d408e-8e80-480c-a6b7-71db1f2c3e59 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:31.157197 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-297d408e-8e80-480c-a6b7-71db1f2c3e59 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:31.182593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-297d408e-8e80-480c-a6b7-71db1f2c3e59 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:31.182593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-297d408e-8e80-480c-a6b7-71db1f2c3e59 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.383163 Jun 16 18:16:31.182593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 484/962] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:30 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:31.327456 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-02217ed5-99f6-4b0b-b54f-0fc9046462eb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:31.344418 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-02217ed5-99f6-4b0b-b54f-0fc9046462eb tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1323 microversion: 2.1 time: 0.253844 Jun 16 18:16:31.345194 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 479/963] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:31 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1323 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:16:32.203731 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-773e03a4-a17f-480d-992e-0ea61f66a02e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:32.204779 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-773e03a4-a17f-480d-992e-0ea61f66a02e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:32.216404 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-773e03a4-a17f-480d-992e-0ea61f66a02e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:32.216927 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-773e03a4-a17f-480d-992e-0ea61f66a02e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:32.217630 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-773e03a4-a17f-480d-992e-0ea61f66a02e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:32.218061 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-773e03a4-a17f-480d-992e-0ea61f66a02e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:32.363124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ab174d14-cdee-4194-bfed-9ccba3616dcf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:32.366275 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ab174d14-cdee-4194-bfed-9ccba3616dcf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:32.379678 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:16:32.380952 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab174d14-cdee-4194-bfed-9ccba3616dcf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:32.381619 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab174d14-cdee-4194-bfed-9ccba3616dcf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:32.382539 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab174d14-cdee-4194-bfed-9ccba3616dcf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:32.383055 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab174d14-cdee-4194-bfed-9ccba3616dcf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:32.438070 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab174d14-cdee-4194-bfed-9ccba3616dcf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:32.438572 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ab174d14-cdee-4194-bfed-9ccba3616dcf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:32.439028 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-ab174d14-cdee-4194-bfed-9ccba3616dcf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lazy-loading 'fault' on Instance uuid 8ceb78ff-a348-4800-9bec-517f2cccc8c3 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:16:32.514946 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ab174d14-cdee-4194-bfed-9ccba3616dcf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '712089cbbf9a424fa5d4412ced2cdc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b0926322074e2da25ddaae611d89d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:32.529567 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ab174d14-cdee-4194-bfed-9ccba3616dcf tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 200 len: 1328 microversion: 2.1 time: 0.170997 Jun 16 18:16:32.530747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 480/964] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:32 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 1328 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:16:32.558636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-773e03a4-a17f-480d-992e-0ea61f66a02e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:32.569832 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-773e03a4-a17f-480d-992e-0ea61f66a02e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:32.572338 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-773e03a4-a17f-480d-992e-0ea61f66a02e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:32.573969 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-773e03a4-a17f-480d-992e-0ea61f66a02e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.382715 Jun 16 18:16:32.574540 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 485/965] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:32 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:33.560669 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-47dd0dee-1b07-4c64-b7f1-ce18bb4168a5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:33.561298 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-47dd0dee-1b07-4c64-b7f1-ce18bb4168a5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:33.571933 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-47dd0dee-1b07-4c64-b7f1-ce18bb4168a5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:33.572405 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-47dd0dee-1b07-4c64-b7f1-ce18bb4168a5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:33.573219 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-47dd0dee-1b07-4c64-b7f1-ce18bb4168a5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:33.573939 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-47dd0dee-1b07-4c64-b7f1-ce18bb4168a5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:33.600101 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a815cb1d-3311-4ad8-bb9c-bc67cf57c2dc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:33.608212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a815cb1d-3311-4ad8-bb9c-bc67cf57c2dc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:33.629978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-47dd0dee-1b07-4c64-b7f1-ce18bb4168a5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] HTTP exception thrown: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:33.635675 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a815cb1d-3311-4ad8-bb9c-bc67cf57c2dc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:33.636947 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a815cb1d-3311-4ad8-bb9c-bc67cf57c2dc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:33.637733 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a815cb1d-3311-4ad8-bb9c-bc67cf57c2dc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:33.638763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a815cb1d-3311-4ad8-bb9c-bc67cf57c2dc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-47dd0dee-1b07-4c64-b7f1-ce18bb4168a5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Request method failure captured: Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 HTTP/1.1 Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E2tp68L59QvxZTQDN_k1jrrL-KnCDrwGAY06wn_g6GOPf6UbtY-jQnpWFNxY81e1m6uopGwB1SNq2mpyhQf4GWlaL-eshSLtE1iPGymbh5BP3-2HaI3gD8N2DfW9hc37yYr8eChINrAXPDDldjN4Yqfvpjm8j8TG9alaZxulL7KGM Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 14b0926322074e2da25ddaae611d89d4 Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:16:33.646232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:16:33.651701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14b0926322074e2da25ddaae611d89d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:16:33.651701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:33.651701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 14b0926322074e2da25ddaae611d89d4 Jun 16 18:16:33.651701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:33.651701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeTestJSON-26965284-project Jun 16 18:16:33.651701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:16:33.651701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:16:33.651701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 712089cbbf9a424fa5d4412ced2cdc58 Jun 16 18:16:33.651701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeTestJSON-26965284-project Jun 16 18:16:33.651701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:16:33.651701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:33.651701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '8ceb78ff-a348-4800-9bec-517f2cccc8c3'} Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:16:33.654228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:33.662469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:33.665199 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-47dd0dee-1b07-4c64-b7f1-ce18bb4168a5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Returning 404 to user: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:16:33.669573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-47dd0dee-1b07-4c64-b7f1-ce18bb4168a5 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 404 len: 111 microversion: 2.1 time: 0.112605 Jun 16 18:16:33.671522 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 481/966] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:33 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:16:33.685992 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a103244e-8f21-478a-b117-d89298c3233b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '.version_select at 0x7f9c23bbdd30>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:33.688704 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:16:33.827305 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a103244e-8f21-478a-b117-d89298c3233b tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769987614" status: 202 len: 0 microversion: 2.1 time: 0.150298 Jun 16 18:16:33.828518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 482/967] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jun 16 18:16:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769987614 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:16:34.113814 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a815cb1d-3311-4ad8-bb9c-bc67cf57c2dc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:34.125890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a815cb1d-3311-4ad8-bb9c-bc67cf57c2dc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:34.133300 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a815cb1d-3311-4ad8-bb9c-bc67cf57c2dc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:34.135598 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a815cb1d-3311-4ad8-bb9c-bc67cf57c2dc tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.546081 Jun 16 18:16:34.155353 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 486/968] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:33 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:35.165653 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-320fbc34-1385-46c3-8449-80c5f4ffea3a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:35.167049 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-320fbc34-1385-46c3-8449-80c5f4ffea3a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:35.195987 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-320fbc34-1385-46c3-8449-80c5f4ffea3a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:35.200438 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-320fbc34-1385-46c3-8449-80c5f4ffea3a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:35.200438 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-320fbc34-1385-46c3-8449-80c5f4ffea3a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:35.200438 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-320fbc34-1385-46c3-8449-80c5f4ffea3a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:35.680273 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-320fbc34-1385-46c3-8449-80c5f4ffea3a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:35.712791 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-320fbc34-1385-46c3-8449-80c5f4ffea3a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:35.712791 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-320fbc34-1385-46c3-8449-80c5f4ffea3a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:35.712791 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-320fbc34-1385-46c3-8449-80c5f4ffea3a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.548959 Jun 16 18:16:35.713388 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 483/969] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:35 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:36.738722 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-775e5b9c-179c-426d-a5b0-8adb79aedc29 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:36.740100 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-775e5b9c-179c-426d-a5b0-8adb79aedc29 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:36.757834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-775e5b9c-179c-426d-a5b0-8adb79aedc29 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:36.758287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-775e5b9c-179c-426d-a5b0-8adb79aedc29 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:36.759160 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-775e5b9c-179c-426d-a5b0-8adb79aedc29 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:36.762597 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-775e5b9c-179c-426d-a5b0-8adb79aedc29 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:37.110307 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-775e5b9c-179c-426d-a5b0-8adb79aedc29 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:37.129315 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-775e5b9c-179c-426d-a5b0-8adb79aedc29 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:37.135135 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-775e5b9c-179c-426d-a5b0-8adb79aedc29 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:37.160702 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-775e5b9c-179c-426d-a5b0-8adb79aedc29 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.423453 Jun 16 18:16:37.163255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 487/970] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:36 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:38.184041 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-cdaf98cb-6130-40ee-aed3-e2c2d396c095 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:38.185001 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-cdaf98cb-6130-40ee-aed3-e2c2d396c095 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:38.193057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cdaf98cb-6130-40ee-aed3-e2c2d396c095 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:38.194068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cdaf98cb-6130-40ee-aed3-e2c2d396c095 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:38.195413 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cdaf98cb-6130-40ee-aed3-e2c2d396c095 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:38.196416 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cdaf98cb-6130-40ee-aed3-e2c2d396c095 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:38.497280 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-cdaf98cb-6130-40ee-aed3-e2c2d396c095 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:38.507420 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-cdaf98cb-6130-40ee-aed3-e2c2d396c095 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:38.509954 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-cdaf98cb-6130-40ee-aed3-e2c2d396c095 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:38.512167 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-cdaf98cb-6130-40ee-aed3-e2c2d396c095 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.333224 Jun 16 18:16:38.513253 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 484/971] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:38 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:39.225339 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-65883ecc-8fd4-4dd6-ac83-6e08eb2b0f26 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:39.227019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-65883ecc-8fd4-4dd6-ac83-6e08eb2b0f26 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:39.270374 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-65883ecc-8fd4-4dd6-ac83-6e08eb2b0f26 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:39.272373 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-65883ecc-8fd4-4dd6-ac83-6e08eb2b0f26 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:39.277987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-65883ecc-8fd4-4dd6-ac83-6e08eb2b0f26 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:39.279056 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-65883ecc-8fd4-4dd6-ac83-6e08eb2b0f26 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:39.331541 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-65883ecc-8fd4-4dd6-ac83-6e08eb2b0f26 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] HTTP exception thrown: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-65883ecc-8fd4-4dd6-ac83-6e08eb2b0f26 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Request method failure captured: Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: DELETE /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 HTTP/1.1 Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3E2tp68L59QvxZTQDN_k1jrrL-KnCDrwGAY06wn_g6GOPf6UbtY-jQnpWFNxY81e1m6uopGwB1SNq2mpyhQf4GWlaL-eshSLtE1iPGymbh5BP3-2HaI3gD8N2DfW9hc37yYr8eChINrAXPDDldjN4Yqfvpjm8j8TG9alaZxulL7KGM Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 14b0926322074e2da25ddaae611d89d4 Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:16:39.336707 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:16:39.338794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14b0926322074e2da25ddaae611d89d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:16:39.338794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:39.338794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 14b0926322074e2da25ddaae611d89d4 Jun 16 18:16:39.338794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:39.338794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-AttachVolumeTestJSON-26965284-project Jun 16 18:16:39.338794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:16:39.338794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:16:39.338794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 712089cbbf9a424fa5d4412ced2cdc58 Jun 16 18:16:39.338794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-AttachVolumeTestJSON-26965284-project Jun 16 18:16:39.338794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:16:39.338794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:39.338794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '8ceb78ff-a348-4800-9bec-517f2cccc8c3'} Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:16:39.340178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:39.342205 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:39.345573 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-65883ecc-8fd4-4dd6-ac83-6e08eb2b0f26 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Returning 404 to user: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:16:39.347811 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-65883ecc-8fd4-4dd6-ac83-6e08eb2b0f26 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 404 len: 111 microversion: 2.1 time: 0.129349 Jun 16 18:16:39.349101 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 488/972] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:16:39 2022] DELETE /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:16:39.357435 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8084e2b4-b13f-4fea-9273-a3593efea605 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:39.359904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8084e2b4-b13f-4fea-9273-a3593efea605 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 8ceb78ff-a348-4800-9bec-517f2cccc8c3] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:39.369264 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8084e2b4-b13f-4fea-9273-a3593efea605 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:39.369923 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8084e2b4-b13f-4fea-9273-a3593efea605 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:39.370894 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8084e2b4-b13f-4fea-9273-a3593efea605 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:39.371530 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8084e2b4-b13f-4fea-9273-a3593efea605 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:39.395835 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-8084e2b4-b13f-4fea-9273-a3593efea605 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] HTTP exception thrown: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8084e2b4-b13f-4fea-9273-a3593efea605 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Request method failure captured: Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 HTTP/1.1 Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E2tp68L59QvxZTQDN_k1jrrL-KnCDrwGAY06wn_g6GOPf6UbtY-jQnpWFNxY81e1m6uopGwB1SNq2mpyhQf4GWlaL-eshSLtE1iPGymbh5BP3-2HaI3gD8N2DfW9hc37yYr8eChINrAXPDDldjN4Yqfvpjm8j8TG9alaZxulL7KGM Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 14b0926322074e2da25ddaae611d89d4 Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:16:39.400841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:16:39.402471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14b0926322074e2da25ddaae611d89d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:16:39.402471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:39.402471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 14b0926322074e2da25ddaae611d89d4 Jun 16 18:16:39.402471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:39.402471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeTestJSON-26965284-project Jun 16 18:16:39.402471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:16:39.402471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:16:39.402471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 712089cbbf9a424fa5d4412ced2cdc58 Jun 16 18:16:39.402471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeTestJSON-26965284-project Jun 16 18:16:39.402471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:16:39.402471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:39.402471 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '8ceb78ff-a348-4800-9bec-517f2cccc8c3'} Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:16:39.403430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. Jun 16 18:16:39.404983 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:39.420366 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8084e2b4-b13f-4fea-9273-a3593efea605 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Returning 404 to user: Instance 8ceb78ff-a348-4800-9bec-517f2cccc8c3 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:16:39.429476 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8084e2b4-b13f-4fea-9273-a3593efea605 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3" status: 404 len: 111 microversion: 2.1 time: 0.068221 Jun 16 18:16:39.429476 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 485/973] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:39 2022] GET /compute/v2.1/servers/8ceb78ff-a348-4800-9bec-517f2cccc8c3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:16:39.536230 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9f41f217-e6d7-49c2-b411-8bcd1a536242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:39.537298 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9f41f217-e6d7-49c2-b411-8bcd1a536242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:39.576054 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f41f217-e6d7-49c2-b411-8bcd1a536242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:39.578569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f41f217-e6d7-49c2-b411-8bcd1a536242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:39.580863 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f41f217-e6d7-49c2-b411-8bcd1a536242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:39.588325 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9f41f217-e6d7-49c2-b411-8bcd1a536242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:39.962147 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9f41f217-e6d7-49c2-b411-8bcd1a536242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:39.973938 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9f41f217-e6d7-49c2-b411-8bcd1a536242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:39.976364 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9f41f217-e6d7-49c2-b411-8bcd1a536242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:39.978017 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9f41f217-e6d7-49c2-b411-8bcd1a536242 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.449754 Jun 16 18:16:39.988000 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 489/974] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:39 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:40.925748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-df5d8275-c065-4fdc-9262-2ab7432a4cfa tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:40.926907 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-df5d8275-c065-4fdc-9262-2ab7432a4cfa tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:40.946367 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-df5d8275-c065-4fdc-9262-2ab7432a4cfa tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:40.946367 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-df5d8275-c065-4fdc-9262-2ab7432a4cfa tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:40.946367 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-df5d8275-c065-4fdc-9262-2ab7432a4cfa tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:40.946367 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-df5d8275-c065-4fdc-9262-2ab7432a4cfa tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:40.981158 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-df5d8275-c065-4fdc-9262-2ab7432a4cfa tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] HTTP exception thrown: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-df5d8275-c065-4fdc-9262-2ab7432a4cfa tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Request method failure captured: Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: DELETE /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 HTTP/1.1 Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E2tp68L59QvxZTQDN_k1jrrL-KnCDrwGAY06wn_g6GOPf6UbtY-jQnpWFNxY81e1m6uopGwB1SNq2mpyhQf4GWlaL-eshSLtE1iPGymbh5BP3-2HaI3gD8N2DfW9hc37yYr8eChINrAXPDDldjN4Yqfvpjm8j8TG9alaZxulL7KGM Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 14b0926322074e2da25ddaae611d89d4 Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:16:40.986633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:16:40.988610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14b0926322074e2da25ddaae611d89d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:16:40.988610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:40.988610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 14b0926322074e2da25ddaae611d89d4 Jun 16 18:16:40.988610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:40.988610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeTestJSON-26965284-project Jun 16 18:16:40.988610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:16:40.988610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:16:40.988610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 712089cbbf9a424fa5d4412ced2cdc58 Jun 16 18:16:40.988610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeTestJSON-26965284-project Jun 16 18:16:40.988610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:16:40.988610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:16:40.988610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '1134706f-4520-434d-877f-bc6465b3e282'} Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:16:40.989559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:16:40.991740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:16:40.993161 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-df5d8275-c065-4fdc-9262-2ab7432a4cfa tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Returning 404 to user: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:16:40.993161 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-df5d8275-c065-4fdc-9262-2ab7432a4cfa tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 404 len: 111 microversion: 2.1 time: 0.063558 Jun 16 18:16:40.993161 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 486/975] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:16:40 2022] DELETE /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:16:40.993394 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7cbb01b8-e250-4599-a24a-e9674c7e8513 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:40.994136 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7cbb01b8-e250-4599-a24a-e9674c7e8513 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] [instance: 1134706f-4520-434d-877f-bc6465b3e282] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:41.007875 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0fbe0554-b21b-4815-b41a-0391638216ed tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:41.009096 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0fbe0554-b21b-4815-b41a-0391638216ed tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:41.014270 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7cbb01b8-e250-4599-a24a-e9674c7e8513 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:41.014882 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7cbb01b8-e250-4599-a24a-e9674c7e8513 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:41.015830 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7cbb01b8-e250-4599-a24a-e9674c7e8513 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:41.016509 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7cbb01b8-e250-4599-a24a-e9674c7e8513 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:41.029300 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0fbe0554-b21b-4815-b41a-0391638216ed tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:41.030384 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0fbe0554-b21b-4815-b41a-0391638216ed tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:41.032604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0fbe0554-b21b-4815-b41a-0391638216ed tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:41.033425 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0fbe0554-b21b-4815-b41a-0391638216ed tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:41.097466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-7cbb01b8-e250-4599-a24a-e9674c7e8513 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] HTTP exception thrown: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7cbb01b8-e250-4599-a24a-e9674c7e8513 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Request method failure captured: Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 HTTP/1.1 Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3E2tp68L59QvxZTQDN_k1jrrL-KnCDrwGAY06wn_g6GOPf6UbtY-jQnpWFNxY81e1m6uopGwB1SNq2mpyhQf4GWlaL-eshSLtE1iPGymbh5BP3-2HaI3gD8N2DfW9hc37yYr8eChINrAXPDDldjN4Yqfvpjm8j8TG9alaZxulL7KGM Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 14b0926322074e2da25ddaae611d89d4 Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:16:41.102039 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:16:41.103861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_14b0926322074e2da25ddaae611d89d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/14b0926322074e2da25ddaae611d89d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:16:41.103861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:41.103861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 14b0926322074e2da25ddaae611d89d4 Jun 16 18:16:41.103861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-AttachVolumeTestJSON-26965284 Jun 16 18:16:41.103861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-AttachVolumeTestJSON-26965284-project Jun 16 18:16:41.103861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:16:41.103861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:16:41.103861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 712089cbbf9a424fa5d4412ced2cdc58 Jun 16 18:16:41.103861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-AttachVolumeTestJSON-26965284-project Jun 16 18:16:41.103861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:16:41.103861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:16:41.103861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '1134706f-4520-434d-877f-bc6465b3e282'} Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:16:41.105005 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. Jun 16 18:16:41.106466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:16:41.113767 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7cbb01b8-e250-4599-a24a-e9674c7e8513 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] Returning 404 to user: Instance 1134706f-4520-434d-877f-bc6465b3e282 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:16:41.116545 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7cbb01b8-e250-4599-a24a-e9674c7e8513 tempest-AttachVolumeTestJSON-26965284 tempest-AttachVolumeTestJSON-26965284-project] 10.222.0.58 "GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282" status: 404 len: 111 microversion: 2.1 time: 0.127111 Jun 16 18:16:41.123073 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 490/976] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:16:40 2022] GET /compute/v2.1/servers/1134706f-4520-434d-877f-bc6465b3e282 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:16:41.315001 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0fbe0554-b21b-4815-b41a-0391638216ed tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:41.338935 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0fbe0554-b21b-4815-b41a-0391638216ed tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:41.343673 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0fbe0554-b21b-4815-b41a-0391638216ed tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:41.344900 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0fbe0554-b21b-4815-b41a-0391638216ed tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.347240 Jun 16 18:16:41.369153 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 487/977] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:40 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:42.368059 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d78db18b-3026-45d5-8096-98dd41de4d67 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:42.368991 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d78db18b-3026-45d5-8096-98dd41de4d67 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:42.386557 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d78db18b-3026-45d5-8096-98dd41de4d67 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:42.388818 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d78db18b-3026-45d5-8096-98dd41de4d67 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:42.393390 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d78db18b-3026-45d5-8096-98dd41de4d67 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:42.395924 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d78db18b-3026-45d5-8096-98dd41de4d67 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:42.733197 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d78db18b-3026-45d5-8096-98dd41de4d67 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:42.747012 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d78db18b-3026-45d5-8096-98dd41de4d67 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:42.749920 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d78db18b-3026-45d5-8096-98dd41de4d67 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:42.751694 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d78db18b-3026-45d5-8096-98dd41de4d67 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.389590 Jun 16 18:16:42.752583 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 491/978] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:42 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:16:43.779806 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2e29de48-7505-4fb6-8186-9d3028ea81e3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:43.781352 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2e29de48-7505-4fb6-8186-9d3028ea81e3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:43.789666 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2e29de48-7505-4fb6-8186-9d3028ea81e3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:43.789666 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2e29de48-7505-4fb6-8186-9d3028ea81e3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:43.791195 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2e29de48-7505-4fb6-8186-9d3028ea81e3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:43.791990 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2e29de48-7505-4fb6-8186-9d3028ea81e3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:43.979607 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2e29de48-7505-4fb6-8186-9d3028ea81e3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:43.992753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2e29de48-7505-4fb6-8186-9d3028ea81e3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:43.994942 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2e29de48-7505-4fb6-8186-9d3028ea81e3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:43.996762 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2e29de48-7505-4fb6-8186-9d3028ea81e3 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.221785 Jun 16 18:16:44.008219 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 488/979] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:43 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:45.545903 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f67680e6-89ef-46fd-b6d6-3d60130b37c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:45.546749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f67680e6-89ef-46fd-b6d6-3d60130b37c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:45.558886 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f67680e6-89ef-46fd-b6d6-3d60130b37c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:45.563354 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f67680e6-89ef-46fd-b6d6-3d60130b37c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:45.568576 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f67680e6-89ef-46fd-b6d6-3d60130b37c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:45.571608 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f67680e6-89ef-46fd-b6d6-3d60130b37c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:45.872586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f67680e6-89ef-46fd-b6d6-3d60130b37c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:45.880976 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f67680e6-89ef-46fd-b6d6-3d60130b37c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:45.883351 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f67680e6-89ef-46fd-b6d6-3d60130b37c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:45.884896 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f67680e6-89ef-46fd-b6d6-3d60130b37c1 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.870693 Jun 16 18:16:45.886078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 492/980] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:45 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:46.914685 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3be8c849-b01b-448e-ab42-c061777358b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:46.918944 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3be8c849-b01b-448e-ab42-c061777358b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:46.923519 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3be8c849-b01b-448e-ab42-c061777358b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:46.924018 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3be8c849-b01b-448e-ab42-c061777358b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:46.924805 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3be8c849-b01b-448e-ab42-c061777358b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:46.925236 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3be8c849-b01b-448e-ab42-c061777358b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:47.208272 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3be8c849-b01b-448e-ab42-c061777358b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:47.217780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3be8c849-b01b-448e-ab42-c061777358b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:47.219301 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3be8c849-b01b-448e-ab42-c061777358b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:47.221253 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3be8c849-b01b-448e-ab42-c061777358b7 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.311275 Jun 16 18:16:47.232689 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 489/981] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:46 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:48.240020 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-eb26f1db-d04c-4271-9780-2db27f404659 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:48.243169 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-eb26f1db-d04c-4271-9780-2db27f404659 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:48.254171 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-eb26f1db-d04c-4271-9780-2db27f404659 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:48.259472 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-eb26f1db-d04c-4271-9780-2db27f404659 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:48.260566 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-eb26f1db-d04c-4271-9780-2db27f404659 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:48.261162 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-eb26f1db-d04c-4271-9780-2db27f404659 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:48.274564 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:INSERT=3,nova_cell1:SELECT=92 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:16:48.382891 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ceb2dc07-eb4d-4753-a0f4-a30b29a30e24 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Action: 'create', calling method: .version_select at 0x7f9c30302d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-629434427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdjw0jVX+RfdRI3twYUI3hW0mCG92YJF5EN0zKTPVLpXqKrv1V8xv5ivEzm8ebd1NWh3wvslsLLNJ3+37w5Q1XjmuMuVFdf0VlNzb4Gx3aRWKAVX0Iiqaw9y0107gx8GA=="}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:16:48.418315 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-ceb2dc07-eb4d-4753-a0f4-a30b29a30e24 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Getting quotas for project bff5c01fd0ab4348b4704765f0195d50. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:16:48.429787 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-ceb2dc07-eb4d-4753-a0f4-a30b29a30e24 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Getting quotas for user f8cc86b384df4223a800838a3d386d3f and project bff5c01fd0ab4348b4704765f0195d50. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:16:48.464162 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-eb26f1db-d04c-4271-9780-2db27f404659 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:48.468407 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-eb26f1db-d04c-4271-9780-2db27f404659 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:48.469917 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-eb26f1db-d04c-4271-9780-2db27f404659 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:48.471138 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-eb26f1db-d04c-4271-9780-2db27f404659 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.235574 Jun 16 18:16:48.471731 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 490/982] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:48 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:48.666374 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ceb2dc07-eb4d-4753-a0f4-a30b29a30e24 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.482689 Jun 16 18:16:48.667562 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 493/983] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jun 16 18:16:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:16:49.492446 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e675d26c-5fb8-4701-ab4c-93ab17a02d6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:49.492446 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e675d26c-5fb8-4701-ab4c-93ab17a02d6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:49.500815 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e675d26c-5fb8-4701-ab4c-93ab17a02d6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:49.501580 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e675d26c-5fb8-4701-ab4c-93ab17a02d6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:49.502526 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e675d26c-5fb8-4701-ab4c-93ab17a02d6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:49.503000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e675d26c-5fb8-4701-ab4c-93ab17a02d6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:49.700710 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e675d26c-5fb8-4701-ab4c-93ab17a02d6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:49.710860 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e675d26c-5fb8-4701-ab4c-93ab17a02d6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:49.712572 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e675d26c-5fb8-4701-ab4c-93ab17a02d6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:49.721869 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e675d26c-5fb8-4701-ab4c-93ab17a02d6c tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.227214 Jun 16 18:16:49.721869 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 491/984] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:49 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:50.734299 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f3164d49-c122-4185-b86c-636322f5531e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:50.735823 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f3164d49-c122-4185-b86c-636322f5531e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:50.748673 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f3164d49-c122-4185-b86c-636322f5531e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:50.749475 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f3164d49-c122-4185-b86c-636322f5531e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:50.750704 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f3164d49-c122-4185-b86c-636322f5531e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:50.751422 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f3164d49-c122-4185-b86c-636322f5531e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:50.975587 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f3164d49-c122-4185-b86c-636322f5531e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:50.986098 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f3164d49-c122-4185-b86c-636322f5531e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:50.988957 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f3164d49-c122-4185-b86c-636322f5531e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:50.991802 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f3164d49-c122-4185-b86c-636322f5531e tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.260859 Jun 16 18:16:50.991802 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 494/985] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:50 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:52.018099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-af340852-dcf0-45b8-97ca-8aea3d311b10 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:52.019430 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-af340852-dcf0-45b8-97ca-8aea3d311b10 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:52.044786 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-af340852-dcf0-45b8-97ca-8aea3d311b10 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:52.045746 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-af340852-dcf0-45b8-97ca-8aea3d311b10 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:52.049010 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-af340852-dcf0-45b8-97ca-8aea3d311b10 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:52.051839 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-af340852-dcf0-45b8-97ca-8aea3d311b10 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:52.286554 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-af340852-dcf0-45b8-97ca-8aea3d311b10 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:52.297277 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-af340852-dcf0-45b8-97ca-8aea3d311b10 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:52.302094 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-af340852-dcf0-45b8-97ca-8aea3d311b10 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:52.307462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-af340852-dcf0-45b8-97ca-8aea3d311b10 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.293739 Jun 16 18:16:52.307462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 492/986] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:52 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:53.329419 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-80522b57-fe81-494b-9e02-fc4a27569f66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:53.330014 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-80522b57-fe81-494b-9e02-fc4a27569f66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:53.337758 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-80522b57-fe81-494b-9e02-fc4a27569f66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:53.338301 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-80522b57-fe81-494b-9e02-fc4a27569f66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:53.339023 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-80522b57-fe81-494b-9e02-fc4a27569f66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:53.339494 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-80522b57-fe81-494b-9e02-fc4a27569f66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:53.456812 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-b9505cb8-ce1f-4011-b865-d80c1e181fcd req-aa137bbb-5eea-4d55-88ab-1e955956cbdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4792d5b1-2139-4dc1-b191-7975b01fc093", "name": "network-vif-plugged", "status": "completed", "tag": "7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:16:53.473881 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-b9505cb8-ce1f-4011-b865-d80c1e181fcd req-aa137bbb-5eea-4d55-88ab-1e955956cbdb service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:53.474813 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-b9505cb8-ce1f-4011-b865-d80c1e181fcd req-aa137bbb-5eea-4d55-88ab-1e955956cbdb service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:53.493093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-b9505cb8-ce1f-4011-b865-d80c1e181fcd req-aa137bbb-5eea-4d55-88ab-1e955956cbdb service nova] Creating event network-vif-plugged:7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e for instance 4792d5b1-2139-4dc1-b191-7975b01fc093 on hv-cinder-83754 Jun 16 18:16:53.502528 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-b9505cb8-ce1f-4011-b865-d80c1e181fcd req-aa137bbb-5eea-4d55-88ab-1e955956cbdb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052845 Jun 16 18:16:53.506573 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 493/987] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:16:53.562762 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-80522b57-fe81-494b-9e02-fc4a27569f66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:53.578990 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-80522b57-fe81-494b-9e02-fc4a27569f66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:53.580939 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-80522b57-fe81-494b-9e02-fc4a27569f66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:53.589055 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-80522b57-fe81-494b-9e02-fc4a27569f66 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.264173 Jun 16 18:16:53.590148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 495/988] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:53 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:54.611953 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b8d6a134-b733-4cef-ae9f-d217e82a1c6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:54.612672 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b8d6a134-b733-4cef-ae9f-d217e82a1c6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:54.622611 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8d6a134-b733-4cef-ae9f-d217e82a1c6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:54.623202 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8d6a134-b733-4cef-ae9f-d217e82a1c6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:54.626175 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8d6a134-b733-4cef-ae9f-d217e82a1c6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:54.626633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b8d6a134-b733-4cef-ae9f-d217e82a1c6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:54.833151 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b8d6a134-b733-4cef-ae9f-d217e82a1c6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:54.849998 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b8d6a134-b733-4cef-ae9f-d217e82a1c6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:54.852151 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b8d6a134-b733-4cef-ae9f-d217e82a1c6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:54.853409 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b8d6a134-b733-4cef-ae9f-d217e82a1c6b tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.247628 Jun 16 18:16:54.854039 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 494/989] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:54 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:55.879404 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-450a43b6-189a-47c0-b816-dcebec6ecaff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:55.880634 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-450a43b6-189a-47c0-b816-dcebec6ecaff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:55.887902 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-450a43b6-189a-47c0-b816-dcebec6ecaff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:55.888407 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-450a43b6-189a-47c0-b816-dcebec6ecaff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:55.889293 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-450a43b6-189a-47c0-b816-dcebec6ecaff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:55.889977 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-450a43b6-189a-47c0-b816-dcebec6ecaff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:56.067225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-450a43b6-189a-47c0-b816-dcebec6ecaff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:56.076440 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-450a43b6-189a-47c0-b816-dcebec6ecaff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:56.078060 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-450a43b6-189a-47c0-b816-dcebec6ecaff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:56.079566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-450a43b6-189a-47c0-b816-dcebec6ecaff tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.204712 Jun 16 18:16:56.080202 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 496/990] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:55 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:57.102629 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-22eb4361-075d-477b-b4e3-5cf34178520f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:57.104083 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-22eb4361-075d-477b-b4e3-5cf34178520f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:57.117659 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-22eb4361-075d-477b-b4e3-5cf34178520f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:57.118508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-22eb4361-075d-477b-b4e3-5cf34178520f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:57.120424 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-22eb4361-075d-477b-b4e3-5cf34178520f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:57.120565 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-22eb4361-075d-477b-b4e3-5cf34178520f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:57.357100 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-22eb4361-075d-477b-b4e3-5cf34178520f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:57.361524 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-22eb4361-075d-477b-b4e3-5cf34178520f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:57.364171 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-22eb4361-075d-477b-b4e3-5cf34178520f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:57.367417 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-22eb4361-075d-477b-b4e3-5cf34178520f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.270527 Jun 16 18:16:57.368760 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 495/991] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:57 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:58.396445 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1a5b1014-6824-4e12-ae85-6a758df44c32 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:58.397165 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1a5b1014-6824-4e12-ae85-6a758df44c32 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:58.404268 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1a5b1014-6824-4e12-ae85-6a758df44c32 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:58.404720 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1a5b1014-6824-4e12-ae85-6a758df44c32 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:58.405532 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1a5b1014-6824-4e12-ae85-6a758df44c32 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:58.405977 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1a5b1014-6824-4e12-ae85-6a758df44c32 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:58.475990 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=4 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:16:58.674599 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1a5b1014-6824-4e12-ae85-6a758df44c32 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:58.690669 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1a5b1014-6824-4e12-ae85-6a758df44c32 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:58.693032 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1a5b1014-6824-4e12-ae85-6a758df44c32 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:58.694693 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1a5b1014-6824-4e12-ae85-6a758df44c32 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1731 microversion: 2.20 time: 0.303917 Jun 16 18:16:58.696305 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 497/992] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:58 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1731 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:16:59.721340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-59c2ebd4-c6a2-420f-99b1-6fa7b2600f6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:16:59.722193 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-59c2ebd4-c6a2-420f-99b1-6fa7b2600f6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:16:59.730380 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-59c2ebd4-c6a2-420f-99b1-6fa7b2600f6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:59.730830 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-59c2ebd4-c6a2-420f-99b1-6fa7b2600f6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:59.731826 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-59c2ebd4-c6a2-420f-99b1-6fa7b2600f6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:16:59.732264 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-59c2ebd4-c6a2-420f-99b1-6fa7b2600f6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:16:59.916947 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-59c2ebd4-c6a2-420f-99b1-6fa7b2600f6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:59.926195 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-59c2ebd4-c6a2-420f-99b1-6fa7b2600f6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:59.927934 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-59c2ebd4-c6a2-420f-99b1-6fa7b2600f6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:16:59.929249 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-59c2ebd4-c6a2-420f-99b1-6fa7b2600f6a tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1718 microversion: 2.20 time: 0.212638 Jun 16 18:16:59.929816 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 496/993] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:16:59 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1718 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:17:10.026998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b6bff4b0-8397-4a88-95c3-c9fa47443b14 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:10.027702 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b6bff4b0-8397-4a88-95c3-c9fa47443b14 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:10.029746 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:10.030451 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=54 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:10.035562 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b6bff4b0-8397-4a88-95c3-c9fa47443b14 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:10.036021 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b6bff4b0-8397-4a88-95c3-c9fa47443b14 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:10.037429 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b6bff4b0-8397-4a88-95c3-c9fa47443b14 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:10.037919 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b6bff4b0-8397-4a88-95c3-c9fa47443b14 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:10.079396 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b6bff4b0-8397-4a88-95c3-c9fa47443b14 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/ips" status: 200 len: 150 microversion: 2.1 time: 0.040320 Jun 16 18:17:10.079396 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 498/994] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jun 16 18:17:10 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:17:18.446640 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4f43bd15-aee1-4972-aa8a-1cf2f34fe463 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b35b8d3-e55e-4a5e-b39b-0e616dc5f0b9"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:17:18.448048 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4f43bd15-aee1-4972-aa8a-1cf2f34fe463 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:18.450905 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:18.451609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=37 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:18.456895 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4f43bd15-aee1-4972-aa8a-1cf2f34fe463 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:18.457346 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4f43bd15-aee1-4972-aa8a-1cf2f34fe463 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:18.458136 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4f43bd15-aee1-4972-aa8a-1cf2f34fe463 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:18.458838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4f43bd15-aee1-4972-aa8a-1cf2f34fe463 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:20.292064 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4f43bd15-aee1-4972-aa8a-1cf2f34fe463 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "POST /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.850057 Jun 16 18:17:20.292887 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 497/995] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:17:18 2022] POST /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/os-volume_attachments => generated 194 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:17:23.210692 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-611239803", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-629434427", "security_groups": [{"name": "tempest-secgroup-smoke-1571274317"}], "block_device_mapping_v2": [{"uuid": "96740ad0-5b5b-48cf-adf2-d1313eb082ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "abadf347-d0dd-4369-8210-959891491bfa"}]}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:17:23.338685 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] validate_networks() for [('abadf347-d0dd-4369-8210-959891491bfa', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:17:23.821092 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:17:23.821770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:17:23.822453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:17:23.822989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:17:23.823593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:17:23.835915 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:23.836360 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:23.837163 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:23.837596 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:23.857667 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Getting quotas for project bff5c01fd0ab4348b4704765f0195d50. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:17:23.862177 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Getting quotas for user f8cc86b384df4223a800838a3d386d3f and project bff5c01fd0ab4348b4704765f0195d50. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:17:23.930664 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:17:23.932665 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96740ad0-5b5b-48cf-adf2-d1313eb082ec',volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:17:24.526447 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f33b94f8-ca8c-44a1-abb8-b9450aa7b8ad tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.319690 Jun 16 18:17:24.528014 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 499/996] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:17:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:17:24.543414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3b8ecc7d-bd1e-4ebc-9cab-3256da5585ef tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:24.544392 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3b8ecc7d-bd1e-4ebc-9cab-3256da5585ef tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:24.619847 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3b8ecc7d-bd1e-4ebc-9cab-3256da5585ef tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:24.635245 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3b8ecc7d-bd1e-4ebc-9cab-3256da5585ef tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1093 microversion: 2.1 time: 0.096977 Jun 16 18:17:24.636896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 498/997] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:24 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1093 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:25.655167 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-945c0bdc-f0a8-465f-92af-0eb7f8af8961 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:25.655851 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-945c0bdc-f0a8-465f-92af-0eb7f8af8961 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:25.728300 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-945c0bdc-f0a8-465f-92af-0eb7f8af8961 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:25.735884 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-945c0bdc-f0a8-465f-92af-0eb7f8af8961 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1093 microversion: 2.1 time: 0.085123 Jun 16 18:17:25.736469 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 500/998] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:25 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:26.757630 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3c4ee318-9997-4022-910e-0ba0314d7335 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:26.758904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3c4ee318-9997-4022-910e-0ba0314d7335 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:26.766090 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3c4ee318-9997-4022-910e-0ba0314d7335 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:26.773923 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3c4ee318-9997-4022-910e-0ba0314d7335 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:26.773923 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3c4ee318-9997-4022-910e-0ba0314d7335 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:26.773923 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3c4ee318-9997-4022-910e-0ba0314d7335 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:26.845316 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3c4ee318-9997-4022-910e-0ba0314d7335 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:26.856249 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3c4ee318-9997-4022-910e-0ba0314d7335 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1143 microversion: 2.1 time: 0.102971 Jun 16 18:17:26.857143 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 499/999] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:26 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1143 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:27.874116 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-96531293-0187-4396-8031-5222e558dcf3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:27.874896 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-96531293-0187-4396-8031-5222e558dcf3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:27.882382 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96531293-0187-4396-8031-5222e558dcf3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:27.882875 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96531293-0187-4396-8031-5222e558dcf3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:27.883717 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96531293-0187-4396-8031-5222e558dcf3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:27.884197 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-96531293-0187-4396-8031-5222e558dcf3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:27.955569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-96531293-0187-4396-8031-5222e558dcf3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:27.964668 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-96531293-0187-4396-8031-5222e558dcf3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1191 microversion: 2.1 time: 0.094343 Jun 16 18:17:27.965447 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 501/1000] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:27 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:28.982308 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4ef0c8f8-a1ef-4323-a59b-09b708ed0e2a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:28.983201 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4ef0c8f8-a1ef-4323-a59b-09b708ed0e2a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:28.990959 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4ef0c8f8-a1ef-4323-a59b-09b708ed0e2a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:28.991868 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4ef0c8f8-a1ef-4323-a59b-09b708ed0e2a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:28.993192 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4ef0c8f8-a1ef-4323-a59b-09b708ed0e2a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:28.994047 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4ef0c8f8-a1ef-4323-a59b-09b708ed0e2a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:29.082965 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4ef0c8f8-a1ef-4323-a59b-09b708ed0e2a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:29.098097 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4ef0c8f8-a1ef-4323-a59b-09b708ed0e2a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1209 microversion: 2.1 time: 0.119622 Jun 16 18:17:29.098677 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 500/1001] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:28 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:30.119259 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8eb9a081-564b-4740-a5f7-6fc05990a520 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:30.120969 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8eb9a081-564b-4740-a5f7-6fc05990a520 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:30.139691 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8eb9a081-564b-4740-a5f7-6fc05990a520 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:30.140379 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8eb9a081-564b-4740-a5f7-6fc05990a520 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:30.141837 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8eb9a081-564b-4740-a5f7-6fc05990a520 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:30.142502 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8eb9a081-564b-4740-a5f7-6fc05990a520 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:30.244644 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8f4c0cb0-34a7-4b24-8aca-a14b7e5752be tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:30.245681 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8f4c0cb0-34a7-4b24-8aca-a14b7e5752be tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:30.258111 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8f4c0cb0-34a7-4b24-8aca-a14b7e5752be tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:30.258841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8f4c0cb0-34a7-4b24-8aca-a14b7e5752be tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:30.259791 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8f4c0cb0-34a7-4b24-8aca-a14b7e5752be tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:30.260190 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8f4c0cb0-34a7-4b24-8aca-a14b7e5752be tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:30.326238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8eb9a081-564b-4740-a5f7-6fc05990a520 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:30.334520 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8eb9a081-564b-4740-a5f7-6fc05990a520 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1277 microversion: 2.1 time: 0.220826 Jun 16 18:17:30.353642 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 502/1002] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:30 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1277 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:30.389452 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-8f4c0cb0-34a7-4b24-8aca-a14b7e5752be tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lazy-loading 'services' on Instance uuid b20865bb-4685-49d2-bdcc-af22788bbd79 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:17:30.767196 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8f4c0cb0-34a7-4b24-8aca-a14b7e5752be tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/os-volume_attachments/4b35b8d3-e55e-4a5e-b39b-0e616dc5f0b9" status: 202 len: 0 microversion: 2.1 time: 0.528300 Jun 16 18:17:30.771439 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 501/1003] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jun 16 18:17:30 2022] DELETE /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/os-volume_attachments/4b35b8d3-e55e-4a5e-b39b-0e616dc5f0b9 => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:17:30.779877 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-51a30ce2-6d88-4fec-9253-e98c9cf1cd94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:30.781159 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-51a30ce2-6d88-4fec-9253-e98c9cf1cd94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:30.789793 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-51a30ce2-6d88-4fec-9253-e98c9cf1cd94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:30.790561 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-51a30ce2-6d88-4fec-9253-e98c9cf1cd94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:30.791586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-51a30ce2-6d88-4fec-9253-e98c9cf1cd94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:30.792179 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-51a30ce2-6d88-4fec-9253-e98c9cf1cd94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:30.827573 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-51a30ce2-6d88-4fec-9253-e98c9cf1cd94 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052571 Jun 16 18:17:30.828161 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 503/1004] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:17:30 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:17:31.366232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-24d28ce5-8563-46c9-9704-494270761085 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:31.367526 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-24d28ce5-8563-46c9-9704-494270761085 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:31.377403 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24d28ce5-8563-46c9-9704-494270761085 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:31.377888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24d28ce5-8563-46c9-9704-494270761085 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:31.378657 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24d28ce5-8563-46c9-9704-494270761085 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:31.391810 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24d28ce5-8563-46c9-9704-494270761085 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:31.669720 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-24d28ce5-8563-46c9-9704-494270761085 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:31.673587 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-24d28ce5-8563-46c9-9704-494270761085 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1277 microversion: 2.1 time: 0.312708 Jun 16 18:17:31.683958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 502/1005] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:31 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1277 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:31.703625 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-278247ce-10d5-4e49-aecf-b8857ad228f6 req-f275d270-5a5e-4d7d-9a83-3b4fc79c3685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae1e37c8-4486-40de-8fed-db9178d0e6f8", "tag": "0bee7f88-0741-40db-a53b-d1e8f2fd6ab0"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:17:31.713364 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-278247ce-10d5-4e49-aecf-b8857ad228f6 req-f275d270-5a5e-4d7d-9a83-3b4fc79c3685 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:31.713809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-278247ce-10d5-4e49-aecf-b8857ad228f6 req-f275d270-5a5e-4d7d-9a83-3b4fc79c3685 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:31.732890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-278247ce-10d5-4e49-aecf-b8857ad228f6 req-f275d270-5a5e-4d7d-9a83-3b4fc79c3685 service nova] Creating event network-changed:0bee7f88-0741-40db-a53b-d1e8f2fd6ab0 for instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 on hv-cinder-83754 Jun 16 18:17:31.738608 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-278247ce-10d5-4e49-aecf-b8857ad228f6 req-f275d270-5a5e-4d7d-9a83-3b4fc79c3685 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296523 Jun 16 18:17:31.739170 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 504/1006] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:17:31.841037 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0ddd0bd1-1095-4ca6-9733-fb04cf3c18af tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:31.848839 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0ddd0bd1-1095-4ca6-9733-fb04cf3c18af tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:31.850253 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ddd0bd1-1095-4ca6-9733-fb04cf3c18af tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:31.850888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ddd0bd1-1095-4ca6-9733-fb04cf3c18af tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:31.851829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ddd0bd1-1095-4ca6-9733-fb04cf3c18af tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:31.852365 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0ddd0bd1-1095-4ca6-9733-fb04cf3c18af tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:31.885394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0ddd0bd1-1095-4ca6-9733-fb04cf3c18af tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049069 Jun 16 18:17:31.885972 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 503/1007] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:17:31 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:17:32.698237 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2526ee6b-c42b-4eaa-8231-83deaf8478b0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:32.699440 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2526ee6b-c42b-4eaa-8231-83deaf8478b0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:32.709755 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2526ee6b-c42b-4eaa-8231-83deaf8478b0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:32.711146 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2526ee6b-c42b-4eaa-8231-83deaf8478b0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:32.711979 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2526ee6b-c42b-4eaa-8231-83deaf8478b0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:32.712792 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2526ee6b-c42b-4eaa-8231-83deaf8478b0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:32.900268 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-81d365ff-0354-4be6-bb28-fc24d9b2ab22 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:32.901269 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-81d365ff-0354-4be6-bb28-fc24d9b2ab22 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:32.911175 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-81d365ff-0354-4be6-bb28-fc24d9b2ab22 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:32.912902 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-81d365ff-0354-4be6-bb28-fc24d9b2ab22 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:32.913912 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-81d365ff-0354-4be6-bb28-fc24d9b2ab22 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:32.914352 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-81d365ff-0354-4be6-bb28-fc24d9b2ab22 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:32.917216 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2526ee6b-c42b-4eaa-8231-83deaf8478b0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:32.925443 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2526ee6b-c42b-4eaa-8231-83deaf8478b0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1265 microversion: 2.1 time: 0.235489 Jun 16 18:17:32.926076 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 505/1008] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:32 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:32.952869 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-81d365ff-0354-4be6-bb28-fc24d9b2ab22 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057543 Jun 16 18:17:32.954340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 504/1009] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:17:32 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:17:33.025398 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-82074611-db2e-4649-a4d5-2f76af386cc3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:33.025955 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-82074611-db2e-4649-a4d5-2f76af386cc3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:33.032114 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-82074611-db2e-4649-a4d5-2f76af386cc3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:33.032554 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-82074611-db2e-4649-a4d5-2f76af386cc3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:33.037156 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-82074611-db2e-4649-a4d5-2f76af386cc3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:33.037156 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-82074611-db2e-4649-a4d5-2f76af386cc3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:33.065622 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-82074611-db2e-4649-a4d5-2f76af386cc3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Going to try to terminate instance {{(pid=118161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:17:33.556839 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-82074611-db2e-4649-a4d5-2f76af386cc3 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 204 len: 0 microversion: 2.1 time: 0.536050 Jun 16 18:17:33.557441 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 506/1010] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:17:33 2022] DELETE /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:17:33.567144 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b9f1f095-8bf5-4500-90a7-95e39e46ac1b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:33.568029 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b9f1f095-8bf5-4500-90a7-95e39e46ac1b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:33.575984 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b9f1f095-8bf5-4500-90a7-95e39e46ac1b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:33.576684 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b9f1f095-8bf5-4500-90a7-95e39e46ac1b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:33.577715 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b9f1f095-8bf5-4500-90a7-95e39e46ac1b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:33.578188 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b9f1f095-8bf5-4500-90a7-95e39e46ac1b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:33.753200 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b9f1f095-8bf5-4500-90a7-95e39e46ac1b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:33.761936 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b9f1f095-8bf5-4500-90a7-95e39e46ac1b tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1683 microversion: 2.1 time: 0.198989 Jun 16 18:17:33.762502 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 505/1011] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:33 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1683 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:17:33.945412 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-33db7f32-6565-45b8-9aa0-e2e4d03ecf83 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:33.946421 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-33db7f32-6565-45b8-9aa0-e2e4d03ecf83 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:33.950263 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:33.959420 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-33db7f32-6565-45b8-9aa0-e2e4d03ecf83 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:33.960187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-33db7f32-6565-45b8-9aa0-e2e4d03ecf83 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:33.961283 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-33db7f32-6565-45b8-9aa0-e2e4d03ecf83 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:33.961980 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-33db7f32-6565-45b8-9aa0-e2e4d03ecf83 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:34.129231 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-33db7f32-6565-45b8-9aa0-e2e4d03ecf83 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:34.137796 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-33db7f32-6565-45b8-9aa0-e2e4d03ecf83 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1265 microversion: 2.1 time: 0.197049 Jun 16 18:17:34.138377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 507/1012] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:33 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:34.782373 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-bfe46f13-8490-4ce6-9fa4-bb62c55087c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:34.782992 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-bfe46f13-8490-4ce6-9fa4-bb62c55087c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:34.785716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:34.792344 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bfe46f13-8490-4ce6-9fa4-bb62c55087c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:34.792791 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bfe46f13-8490-4ce6-9fa4-bb62c55087c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:34.793575 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bfe46f13-8490-4ce6-9fa4-bb62c55087c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:34.794003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bfe46f13-8490-4ce6-9fa4-bb62c55087c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:34.946130 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-bfe46f13-8490-4ce6-9fa4-bb62c55087c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:34.956962 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-bfe46f13-8490-4ce6-9fa4-bb62c55087c0 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1683 microversion: 2.1 time: 0.179049 Jun 16 18:17:34.957576 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 506/1013] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:34 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:17:35.157024 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2e43061a-d870-4dd3-8485-e3565fe677da tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:35.157566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2e43061a-d870-4dd3-8485-e3565fe677da tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:35.164367 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e43061a-d870-4dd3-8485-e3565fe677da tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:35.164812 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e43061a-d870-4dd3-8485-e3565fe677da tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:35.165567 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e43061a-d870-4dd3-8485-e3565fe677da tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:35.165998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2e43061a-d870-4dd3-8485-e3565fe677da tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:35.422517 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2e43061a-d870-4dd3-8485-e3565fe677da tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:35.434850 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2e43061a-d870-4dd3-8485-e3565fe677da tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1265 microversion: 2.1 time: 0.282100 Jun 16 18:17:35.435453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 508/1014] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:35 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:17:35.976375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3a33256d-3f6b-4a4b-9f88-d6afd503a3fb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:35.977090 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3a33256d-3f6b-4a4b-9f88-d6afd503a3fb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:35.984255 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3a33256d-3f6b-4a4b-9f88-d6afd503a3fb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:35.984612 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3a33256d-3f6b-4a4b-9f88-d6afd503a3fb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:35.989562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3a33256d-3f6b-4a4b-9f88-d6afd503a3fb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:35.989562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3a33256d-3f6b-4a4b-9f88-d6afd503a3fb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:36.125683 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3a33256d-3f6b-4a4b-9f88-d6afd503a3fb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:36.134820 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3a33256d-3f6b-4a4b-9f88-d6afd503a3fb tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1683 microversion: 2.1 time: 0.163030 Jun 16 18:17:36.135416 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 507/1015] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:35 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:36.452620 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f4983ae9-a157-453a-a349-374a52e06ad9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:36.453252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f4983ae9-a157-453a-a349-374a52e06ad9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:36.455148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=8 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:36.460936 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f4983ae9-a157-453a-a349-374a52e06ad9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:36.461389 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f4983ae9-a157-453a-a349-374a52e06ad9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:36.462259 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f4983ae9-a157-453a-a349-374a52e06ad9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:36.462599 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f4983ae9-a157-453a-a349-374a52e06ad9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:36.621491 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f4983ae9-a157-453a-a349-374a52e06ad9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:36.631010 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f4983ae9-a157-453a-a349-374a52e06ad9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1265 microversion: 2.1 time: 0.182599 Jun 16 18:17:36.632096 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 509/1016] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:36 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:37.153826 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1d76ca1b-11e4-4bb0-aa36-b20497bf0664 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:37.155115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1d76ca1b-11e4-4bb0-aa36-b20497bf0664 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:37.162533 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1d76ca1b-11e4-4bb0-aa36-b20497bf0664 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:37.162988 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1d76ca1b-11e4-4bb0-aa36-b20497bf0664 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:37.163799 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1d76ca1b-11e4-4bb0-aa36-b20497bf0664 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:37.164238 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1d76ca1b-11e4-4bb0-aa36-b20497bf0664 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:37.236331 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1d76ca1b-11e4-4bb0-aa36-b20497bf0664 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:37.244838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1d76ca1b-11e4-4bb0-aa36-b20497bf0664 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1615 microversion: 2.1 time: 0.094937 Jun 16 18:17:37.245820 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 508/1017] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:37 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1615 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:37.264364 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-d50455dc-f95d-4965-ade1-6d15a5ade64e req-b4b82f5e-3b0f-419e-b2f8-81837ad12389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b20865bb-4685-49d2-bdcc-af22788bbd79", "name": "network-vif-deleted", "tag": "82ce140e-3dae-4543-849e-c5dd94c7963f"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:17:37.278714 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-d50455dc-f95d-4965-ade1-6d15a5ade64e req-b4b82f5e-3b0f-419e-b2f8-81837ad12389 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:37.279262 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-d50455dc-f95d-4965-ade1-6d15a5ade64e req-b4b82f5e-3b0f-419e-b2f8-81837ad12389 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:37.293147 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-d50455dc-f95d-4965-ade1-6d15a5ade64e req-b4b82f5e-3b0f-419e-b2f8-81837ad12389 service nova] Creating event network-vif-deleted:82ce140e-3dae-4543-849e-c5dd94c7963f for instance b20865bb-4685-49d2-bdcc-af22788bbd79 on hv-cinder-83754 Jun 16 18:17:37.298648 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-d50455dc-f95d-4965-ade1-6d15a5ade64e req-b4b82f5e-3b0f-419e-b2f8-81837ad12389 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048147 Jun 16 18:17:37.299893 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 510/1018] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:17:37.653898 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2fdb0289-660f-4b8b-bf6a-7723d39b7cac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:37.655397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2fdb0289-660f-4b8b-bf6a-7723d39b7cac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:37.674379 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2fdb0289-660f-4b8b-bf6a-7723d39b7cac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:37.674379 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2fdb0289-660f-4b8b-bf6a-7723d39b7cac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:37.674379 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2fdb0289-660f-4b8b-bf6a-7723d39b7cac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:37.674379 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2fdb0289-660f-4b8b-bf6a-7723d39b7cac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:37.864296 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2fdb0289-660f-4b8b-bf6a-7723d39b7cac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:37.873050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2fdb0289-660f-4b8b-bf6a-7723d39b7cac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1265 microversion: 2.1 time: 0.227693 Jun 16 18:17:37.873624 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 509/1019] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:37 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:38.264887 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8361e594-a38e-4e78-9e72-5f13e21aaf8d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:38.265379 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8361e594-a38e-4e78-9e72-5f13e21aaf8d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:38.274699 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8361e594-a38e-4e78-9e72-5f13e21aaf8d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:38.275148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8361e594-a38e-4e78-9e72-5f13e21aaf8d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:38.275958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8361e594-a38e-4e78-9e72-5f13e21aaf8d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:38.276555 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8361e594-a38e-4e78-9e72-5f13e21aaf8d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:38.314090 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8361e594-a38e-4e78-9e72-5f13e21aaf8d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:38.314531 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8361e594-a38e-4e78-9e72-5f13e21aaf8d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:38.314976 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-8361e594-a38e-4e78-9e72-5f13e21aaf8d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lazy-loading 'fault' on Instance uuid b20865bb-4685-49d2-bdcc-af22788bbd79 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:17:38.372113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8361e594-a38e-4e78-9e72-5f13e21aaf8d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8498989e673d445dbc70aa9df55f391b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ad7a8c562934b3c843b10d79f31fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:38.384829 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8361e594-a38e-4e78-9e72-5f13e21aaf8d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 200 len: 1332 microversion: 2.1 time: 0.124384 Jun 16 18:17:38.385947 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 511/1020] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:38 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:38.893460 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d4c64c81-141c-4974-8283-2b75689eb189 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:38.894083 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d4c64c81-141c-4974-8283-2b75689eb189 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:38.900907 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d4c64c81-141c-4974-8283-2b75689eb189 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:38.901397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d4c64c81-141c-4974-8283-2b75689eb189 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:38.902184 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d4c64c81-141c-4974-8283-2b75689eb189 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:38.902621 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d4c64c81-141c-4974-8283-2b75689eb189 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:39.052899 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d4c64c81-141c-4974-8283-2b75689eb189 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:39.060630 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d4c64c81-141c-4974-8283-2b75689eb189 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1265 microversion: 2.1 time: 0.172034 Jun 16 18:17:39.062037 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 510/1021] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:38 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:39.410904 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e735a353-2cfe-428d-80a9-f4ccb35e6e33 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:39.412196 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e735a353-2cfe-428d-80a9-f4ccb35e6e33 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:39.419307 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e735a353-2cfe-428d-80a9-f4ccb35e6e33 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:39.420135 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e735a353-2cfe-428d-80a9-f4ccb35e6e33 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:39.421131 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e735a353-2cfe-428d-80a9-f4ccb35e6e33 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:39.421766 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e735a353-2cfe-428d-80a9-f4ccb35e6e33 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:39.440020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-e735a353-2cfe-428d-80a9-f4ccb35e6e33 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e735a353-2cfe-428d-80a9-f4ccb35e6e33 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 HTTP/1.1 Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:17:39.441741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:17:39.443728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:17:39.443728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:39.443728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:39.443728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:39.443728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:39.443728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:17:39.443728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:17:39.443728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:17:39.443728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:39.443728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:17:39.443728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:39.443728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': 'b20865bb-4685-49d2-bdcc-af22788bbd79'} Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:17:39.444820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:39.446474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:39.453492 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e735a353-2cfe-428d-80a9-f4ccb35e6e33 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 404 to user: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:17:39.453492 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e735a353-2cfe-428d-80a9-f4ccb35e6e33 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 404 len: 111 microversion: 2.1 time: 0.036857 Jun 16 18:17:39.453492 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 512/1022] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:39 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:17:39.455358 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a13081ef-e37c-4b3c-b1d8-249db0d9cae2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '.version_select at 0x7f9c23bbdee0>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:39.701168 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a13081ef-e37c-4b3c-b1d8-249db0d9cae2 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580675369" status: 202 len: 0 microversion: 2.1 time: 0.251148 Jun 16 18:17:39.701918 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 511/1023] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Jun 16 18:17:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1580675369 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:17:40.078950 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2f9a7734-d3c3-43c4-a569-bc6c8ac5a294 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:40.079673 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2f9a7734-d3c3-43c4-a569-bc6c8ac5a294 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:40.086629 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2f9a7734-d3c3-43c4-a569-bc6c8ac5a294 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:40.087081 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2f9a7734-d3c3-43c4-a569-bc6c8ac5a294 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:40.087892 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2f9a7734-d3c3-43c4-a569-bc6c8ac5a294 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:40.088334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2f9a7734-d3c3-43c4-a569-bc6c8ac5a294 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:40.237794 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2f9a7734-d3c3-43c4-a569-bc6c8ac5a294 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:40.246974 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2f9a7734-d3c3-43c4-a569-bc6c8ac5a294 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1265 microversion: 2.1 time: 0.172206 Jun 16 18:17:40.247584 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 513/1024] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:40 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:41.266753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8564b215-805d-46eb-9400-e36084858e4a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:41.267622 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8564b215-805d-46eb-9400-e36084858e4a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:41.275484 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8564b215-805d-46eb-9400-e36084858e4a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:41.276020 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8564b215-805d-46eb-9400-e36084858e4a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:41.276798 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8564b215-805d-46eb-9400-e36084858e4a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:41.277236 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8564b215-805d-46eb-9400-e36084858e4a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:41.414451 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8564b215-805d-46eb-9400-e36084858e4a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:41.422131 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8564b215-805d-46eb-9400-e36084858e4a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1265 microversion: 2.1 time: 0.160012 Jun 16 18:17:41.422700 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 512/1025] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:41 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:42.015043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b3a25c0c-f986-49e2-a2c1-41475c2e641c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:42.016077 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b3a25c0c-f986-49e2-a2c1-41475c2e641c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:42.023063 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b3a25c0c-f986-49e2-a2c1-41475c2e641c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:42.023063 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b3a25c0c-f986-49e2-a2c1-41475c2e641c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:42.023548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b3a25c0c-f986-49e2-a2c1-41475c2e641c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:42.023981 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b3a25c0c-f986-49e2-a2c1-41475c2e641c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:42.037844 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-b3a25c0c-f986-49e2-a2c1-41475c2e641c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b3a25c0c-f986-49e2-a2c1-41475c2e641c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: DELETE /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 HTTP/1.1 Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:17:42.039418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:17:42.040899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:17:42.040899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:42.040899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:42.040899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:42.040899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:42.040899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:17:42.040899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:17:42.040899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:17:42.040899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:42.040899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:17:42.040899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:42.040899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': 'b20865bb-4685-49d2-bdcc-af22788bbd79'} Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:17:42.041869 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:42.043306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:42.045879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b3a25c0c-f986-49e2-a2c1-41475c2e641c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 404 to user: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:17:42.045879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b3a25c0c-f986-49e2-a2c1-41475c2e641c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 404 len: 111 microversion: 2.1 time: 0.030369 Jun 16 18:17:42.045879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 514/1026] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:17:42 2022] DELETE /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:17:42.051534 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-de736c14-2044-4d4c-9332-dc01cd11ccb4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:42.052692 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-de736c14-2044-4d4c-9332-dc01cd11ccb4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: b20865bb-4685-49d2-bdcc-af22788bbd79] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:42.059073 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-de736c14-2044-4d4c-9332-dc01cd11ccb4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:42.059500 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-de736c14-2044-4d4c-9332-dc01cd11ccb4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:42.060389 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-de736c14-2044-4d4c-9332-dc01cd11ccb4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:42.060828 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-de736c14-2044-4d4c-9332-dc01cd11ccb4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:42.075684 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-de736c14-2044-4d4c-9332-dc01cd11ccb4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-de736c14-2044-4d4c-9332-dc01cd11ccb4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 HTTP/1.1 Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:17:42.077631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:17:42.079026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:17:42.079026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:42.079026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:42.079026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:42.079026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:42.079026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:17:42.079026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:17:42.079026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:17:42.079026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:42.079026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:17:42.079026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:42.079026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': 'b20865bb-4685-49d2-bdcc-af22788bbd79'} Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:17:42.080000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. Jun 16 18:17:42.081230 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:42.082397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-de736c14-2044-4d4c-9332-dc01cd11ccb4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 404 to user: Instance b20865bb-4685-49d2-bdcc-af22788bbd79 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:17:42.082397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-de736c14-2044-4d4c-9332-dc01cd11ccb4 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79" status: 404 len: 111 microversion: 2.1 time: 0.031542 Jun 16 18:17:42.082397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 513/1027] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:42 2022] GET /compute/v2.1/servers/b20865bb-4685-49d2-bdcc-af22788bbd79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:17:42.440091 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b9e04c0d-1c1d-4740-b490-cfd273f1964d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:42.440704 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b9e04c0d-1c1d-4740-b490-cfd273f1964d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:42.447049 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b9e04c0d-1c1d-4740-b490-cfd273f1964d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:42.450197 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b9e04c0d-1c1d-4740-b490-cfd273f1964d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:42.450197 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b9e04c0d-1c1d-4740-b490-cfd273f1964d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:42.450197 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b9e04c0d-1c1d-4740-b490-cfd273f1964d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:42.600739 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b9e04c0d-1c1d-4740-b490-cfd273f1964d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:42.609153 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b9e04c0d-1c1d-4740-b490-cfd273f1964d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1265 microversion: 2.1 time: 0.173537 Jun 16 18:17:42.609799 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 515/1028] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:42 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:43.467201 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9432f1d8-8ffa-49b3-89a3-5ea4be151a66 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:43.468311 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9432f1d8-8ffa-49b3-89a3-5ea4be151a66 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:43.475023 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9432f1d8-8ffa-49b3-89a3-5ea4be151a66 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:43.475518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9432f1d8-8ffa-49b3-89a3-5ea4be151a66 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:43.476295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9432f1d8-8ffa-49b3-89a3-5ea4be151a66 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:43.476732 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9432f1d8-8ffa-49b3-89a3-5ea4be151a66 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:43.480963 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:43.491469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-9432f1d8-8ffa-49b3-89a3-5ea4be151a66 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9432f1d8-8ffa-49b3-89a3-5ea4be151a66 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: DELETE /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c HTTP/1.1 Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:17:43.493046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:17:43.495748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:17:43.495748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:43.495748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:43.495748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:43.495748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:43.495748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:17:43.495748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:17:43.495748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:17:43.495748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:43.495748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:17:43.495748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:17:43.495748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '5661854e-8257-40d2-a5a1-44224818fe5c'} Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:17:43.496544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:17:43.499186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.502005 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9432f1d8-8ffa-49b3-89a3-5ea4be151a66 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 404 to user: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:17:43.502005 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9432f1d8-8ffa-49b3-89a3-5ea4be151a66 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 404 len: 111 microversion: 2.1 time: 0.031150 Jun 16 18:17:43.502005 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 514/1029] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:17:43 2022] DELETE /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:17:43.506079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1886a09f-3765-4a7a-9505-b9a98921f61d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:43.506833 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1886a09f-3765-4a7a-9505-b9a98921f61d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 5661854e-8257-40d2-a5a1-44224818fe5c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:43.513760 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1886a09f-3765-4a7a-9505-b9a98921f61d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:43.514457 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1886a09f-3765-4a7a-9505-b9a98921f61d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:43.515257 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1886a09f-3765-4a7a-9505-b9a98921f61d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:43.515797 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1886a09f-3765-4a7a-9505-b9a98921f61d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:43.531796 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-1886a09f-3765-4a7a-9505-b9a98921f61d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1886a09f-3765-4a7a-9505-b9a98921f61d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c HTTP/1.1 Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:17:43.533363 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:17:43.534958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:17:43.534958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:43.534958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:43.534958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:43.534958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:43.534958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:17:43.534958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:17:43.534958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:17:43.534958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:43.534958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:17:43.534958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:17:43.534958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '5661854e-8257-40d2-a5a1-44224818fe5c'} Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:17:43.536020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. Jun 16 18:17:43.538034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.539644 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1886a09f-3765-4a7a-9505-b9a98921f61d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 404 to user: Instance 5661854e-8257-40d2-a5a1-44224818fe5c could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:17:43.539644 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1886a09f-3765-4a7a-9505-b9a98921f61d tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c" status: 404 len: 111 microversion: 2.1 time: 0.034526 Jun 16 18:17:43.539644 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 516/1030] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:43 2022] GET /compute/v2.1/servers/5661854e-8257-40d2-a5a1-44224818fe5c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:17:43.545289 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a9e7bde6-80ad-4ac6-a6d9-22bb9f6c9bc9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:43.545980 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a9e7bde6-80ad-4ac6-a6d9-22bb9f6c9bc9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:43.553429 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a9e7bde6-80ad-4ac6-a6d9-22bb9f6c9bc9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:43.553936 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a9e7bde6-80ad-4ac6-a6d9-22bb9f6c9bc9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:43.554760 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a9e7bde6-80ad-4ac6-a6d9-22bb9f6c9bc9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:43.555198 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a9e7bde6-80ad-4ac6-a6d9-22bb9f6c9bc9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:43.579978 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-a9e7bde6-80ad-4ac6-a6d9-22bb9f6c9bc9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a9e7bde6-80ad-4ac6-a6d9-22bb9f6c9bc9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: DELETE /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c HTTP/1.1 Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:17:43.580694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:17:43.583560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:17:43.583560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:43.583560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:43.583560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:43.583560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:43.583560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:17:43.583560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:17:43.583560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:17:43.583560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:43.583560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:17:43.583560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:17:43.583560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '3a820253-c5ce-455d-9bf7-ded303efc37c'} Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:17:43.585394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:17:43.588817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.591829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a9e7bde6-80ad-4ac6-a6d9-22bb9f6c9bc9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 404 to user: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:17:43.591829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a9e7bde6-80ad-4ac6-a6d9-22bb9f6c9bc9 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 404 len: 111 microversion: 2.1 time: 0.041398 Jun 16 18:17:43.591829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 515/1031] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:17:43 2022] DELETE /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:17:43.599755 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-00a68cb6-1e73-4662-979b-86cce6f72ff8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:43.600336 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-00a68cb6-1e73-4662-979b-86cce6f72ff8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 3a820253-c5ce-455d-9bf7-ded303efc37c] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:43.608290 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-00a68cb6-1e73-4662-979b-86cce6f72ff8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:43.608882 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-00a68cb6-1e73-4662-979b-86cce6f72ff8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:43.609799 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-00a68cb6-1e73-4662-979b-86cce6f72ff8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:43.610353 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-00a68cb6-1e73-4662-979b-86cce6f72ff8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:43.636515 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-740812fd-13b5-4433-96c5-b2cbcc3ea850 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:43.637602 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-740812fd-13b5-4433-96c5-b2cbcc3ea850 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:43.640197 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-00a68cb6-1e73-4662-979b-86cce6f72ff8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-00a68cb6-1e73-4662-979b-86cce6f72ff8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c HTTP/1.1 Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:17:43.642319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:17:43.644834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:17:43.644834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:43.644834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:43.644834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:43.644834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:43.644834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:17:43.644834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:17:43.644834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:17:43.644834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:43.644834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:17:43.644834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:17:43.644834 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '3a820253-c5ce-455d-9bf7-ded303efc37c'} Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:17:43.647867 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. Jun 16 18:17:43.649770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:43.652445 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-00a68cb6-1e73-4662-979b-86cce6f72ff8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 404 to user: Instance 3a820253-c5ce-455d-9bf7-ded303efc37c could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:17:43.652445 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-00a68cb6-1e73-4662-979b-86cce6f72ff8 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c" status: 404 len: 111 microversion: 2.1 time: 0.054402 Jun 16 18:17:43.652445 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 517/1032] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:43 2022] GET /compute/v2.1/servers/3a820253-c5ce-455d-9bf7-ded303efc37c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:17:43.654960 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-740812fd-13b5-4433-96c5-b2cbcc3ea850 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:43.655661 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-740812fd-13b5-4433-96c5-b2cbcc3ea850 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:43.656412 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-740812fd-13b5-4433-96c5-b2cbcc3ea850 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:43.656918 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-740812fd-13b5-4433-96c5-b2cbcc3ea850 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:43.830344 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-6459f09a-5717-4f89-92c4-ccda3f0a5a40 req-f1f9b781-30b6-4441-a6a2-45e4370ef580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae1e37c8-4486-40de-8fed-db9178d0e6f8", "name": "network-vif-plugged", "status": "completed", "tag": "0bee7f88-0741-40db-a53b-d1e8f2fd6ab0"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:17:43.839925 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-6459f09a-5717-4f89-92c4-ccda3f0a5a40 req-f1f9b781-30b6-4441-a6a2-45e4370ef580 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:43.840290 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-6459f09a-5717-4f89-92c4-ccda3f0a5a40 req-f1f9b781-30b6-4441-a6a2-45e4370ef580 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:43.846571 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-740812fd-13b5-4433-96c5-b2cbcc3ea850 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:43.857118 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-6459f09a-5717-4f89-92c4-ccda3f0a5a40 req-f1f9b781-30b6-4441-a6a2-45e4370ef580 service nova] Creating event network-vif-plugged:0bee7f88-0741-40db-a53b-d1e8f2fd6ab0 for instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 on hv-cinder-83754 Jun 16 18:17:43.859835 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-740812fd-13b5-4433-96c5-b2cbcc3ea850 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1265 microversion: 2.1 time: 0.233476 Jun 16 18:17:43.860841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 516/1033] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:43 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:17:43.863015 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-6459f09a-5717-4f89-92c4-ccda3f0a5a40 req-f1f9b781-30b6-4441-a6a2-45e4370ef580 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038301 Jun 16 18:17:43.863632 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 518/1034] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:17:44.880652 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f75a5e03-f9ab-4cbf-a0c6-ebfdc09c8bf4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:44.881723 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f75a5e03-f9ab-4cbf-a0c6-ebfdc09c8bf4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:44.888861 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f75a5e03-f9ab-4cbf-a0c6-ebfdc09c8bf4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:44.889581 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f75a5e03-f9ab-4cbf-a0c6-ebfdc09c8bf4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:44.890279 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f75a5e03-f9ab-4cbf-a0c6-ebfdc09c8bf4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:44.890970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f75a5e03-f9ab-4cbf-a0c6-ebfdc09c8bf4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:45.038201 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f75a5e03-f9ab-4cbf-a0c6-ebfdc09c8bf4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:45.048399 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f75a5e03-f9ab-4cbf-a0c6-ebfdc09c8bf4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1265 microversion: 2.1 time: 0.170679 Jun 16 18:17:45.048399 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 517/1035] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:44 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:17:45.053364 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-cebe45ef-5509-4cb2-b24e-4af7f047714c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:45.054351 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-cebe45ef-5509-4cb2-b24e-4af7f047714c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:45.061463 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cebe45ef-5509-4cb2-b24e-4af7f047714c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:45.061899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cebe45ef-5509-4cb2-b24e-4af7f047714c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:45.062672 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cebe45ef-5509-4cb2-b24e-4af7f047714c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:45.063111 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-cebe45ef-5509-4cb2-b24e-4af7f047714c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:45.068297 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:45.079016 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-cebe45ef-5509-4cb2-b24e-4af7f047714c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-cebe45ef-5509-4cb2-b24e-4af7f047714c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: DELETE /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e HTTP/1.1 Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:17:45.080749 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:17:45.082413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:17:45.082413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:45.082413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:45.082413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:45.082413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:45.082413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:17:45.082413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:17:45.082413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:17:45.082413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:45.082413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:17:45.082413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:17:45.082413 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '77efc8cd-421f-42e8-98e5-cb9e269e9e6e'} Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:17:45.083504 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:17:45.085243 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:17:45.086825 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-cebe45ef-5509-4cb2-b24e-4af7f047714c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 404 to user: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:17:45.086825 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-cebe45ef-5509-4cb2-b24e-4af7f047714c tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "DELETE /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 404 len: 111 microversion: 2.1 time: 0.034881 Jun 16 18:17:45.086825 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 519/1036] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:17:45 2022] DELETE /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:17:45.092313 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b2a0e327-b9c6-44dc-a133-0255452b5a90 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:45.092921 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b2a0e327-b9c6-44dc-a133-0255452b5a90 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] [instance: 77efc8cd-421f-42e8-98e5-cb9e269e9e6e] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:45.100015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b2a0e327-b9c6-44dc-a133-0255452b5a90 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:45.100469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b2a0e327-b9c6-44dc-a133-0255452b5a90 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:45.102001 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b2a0e327-b9c6-44dc-a133-0255452b5a90 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:45.102001 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b2a0e327-b9c6-44dc-a133-0255452b5a90 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:45.116614 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-b2a0e327-b9c6-44dc-a133-0255452b5a90 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] HTTP exception thrown: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b2a0e327-b9c6-44dc-a133-0255452b5a90 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Request method failure captured: Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e HTTP/1.1 Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E3FJaJQ000_17Sw_wfcJK1Q1oVjEOPhhFOJ2UhqzUVAMiXV65OL55W8kKeaym9I_UwwygLPk-x-WdbnbYn8an1yra6TrSOYkOVMAvaoccg-9F07KPmORwlYkNECQxLSLFFBla1j-56Rdye3HRjR5linx9lQy083V6TtVjSWugdp6Q Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:17:45.120831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:17:45.122518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5ad7a8c562934b3c843b10d79f31fee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:17:45.122518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:45.122518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 5ad7a8c562934b3c843b10d79f31fee5 Jun 16 18:17:45.122518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1816162648 Jun 16 18:17:45.122518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:45.122518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:17:45.122518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:17:45.122518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 8498989e673d445dbc70aa9df55f391b Jun 16 18:17:45.122518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeNegativeTest-1816162648-project Jun 16 18:17:45.122518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:17:45.122518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:17:45.122518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '77efc8cd-421f-42e8-98e5-cb9e269e9e6e'} Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:17:45.123562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. Jun 16 18:17:45.125038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:17:45.126422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b2a0e327-b9c6-44dc-a133-0255452b5a90 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] Returning 404 to user: Instance 77efc8cd-421f-42e8-98e5-cb9e269e9e6e could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:17:45.126422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b2a0e327-b9c6-44dc-a133-0255452b5a90 tempest-AttachVolumeNegativeTest-1816162648 tempest-AttachVolumeNegativeTest-1816162648-project] 10.222.0.58 "GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e" status: 404 len: 111 microversion: 2.1 time: 0.031136 Jun 16 18:17:45.126422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 518/1037] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:45 2022] GET /compute/v2.1/servers/77efc8cd-421f-42e8-98e5-cb9e269e9e6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:17:46.068286 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-789bf1e7-ccb2-4cb9-9d1f-e185c7197183 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:46.069601 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-789bf1e7-ccb2-4cb9-9d1f-e185c7197183 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:46.077949 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-789bf1e7-ccb2-4cb9-9d1f-e185c7197183 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:46.078399 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-789bf1e7-ccb2-4cb9-9d1f-e185c7197183 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:46.079177 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-789bf1e7-ccb2-4cb9-9d1f-e185c7197183 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:46.079642 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-789bf1e7-ccb2-4cb9-9d1f-e185c7197183 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:46.241032 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-789bf1e7-ccb2-4cb9-9d1f-e185c7197183 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:46.249804 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-789bf1e7-ccb2-4cb9-9d1f-e185c7197183 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1453 microversion: 2.1 time: 0.187288 Jun 16 18:17:46.249922 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 520/1038] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:46 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1453 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:46.266571 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-fb9d18d8-c04f-49fc-911d-6a1b0d8f1ae4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:46.267183 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-fb9d18d8-c04f-49fc-911d-6a1b0d8f1ae4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:46.274896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fb9d18d8-c04f-49fc-911d-6a1b0d8f1ae4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:46.275347 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fb9d18d8-c04f-49fc-911d-6a1b0d8f1ae4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:46.276162 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fb9d18d8-c04f-49fc-911d-6a1b0d8f1ae4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:46.276605 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fb9d18d8-c04f-49fc-911d-6a1b0d8f1ae4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:46.448128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-fb9d18d8-c04f-49fc-911d-6a1b0d8f1ae4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:46.460044 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-fb9d18d8-c04f-49fc-911d-6a1b0d8f1ae4 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1453 microversion: 2.1 time: 0.197309 Jun 16 18:17:46.461165 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 519/1039] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:17:46 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:50.267325 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-2246e0b8-fbc8-4a4a-be39-ab4722afdd68 req-b78308f6-ed11-4cb9-8cb5-057bb6a31f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae1e37c8-4486-40de-8fed-db9178d0e6f8", "tag": "0bee7f88-0741-40db-a53b-d1e8f2fd6ab0"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:17:50.284775 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-2246e0b8-fbc8-4a4a-be39-ab4722afdd68 req-b78308f6-ed11-4cb9-8cb5-057bb6a31f71 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:50.285864 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-2246e0b8-fbc8-4a4a-be39-ab4722afdd68 req-b78308f6-ed11-4cb9-8cb5-057bb6a31f71 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:50.298983 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-2246e0b8-fbc8-4a4a-be39-ab4722afdd68 req-b78308f6-ed11-4cb9-8cb5-057bb6a31f71 service nova] Creating event network-changed:0bee7f88-0741-40db-a53b-d1e8f2fd6ab0 for instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 on hv-cinder-83754 Jun 16 18:17:50.306130 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-2246e0b8-fbc8-4a4a-be39-ab4722afdd68 req-b78308f6-ed11-4cb9-8cb5-057bb6a31f71 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041986 Jun 16 18:17:50.306984 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 521/1040] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:17:55.534605 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-06d601fd-983e-4487-8420-b43a23840970 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:55.535605 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-06d601fd-983e-4487-8420-b43a23840970 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:55.539091 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:55.544462 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06d601fd-983e-4487-8420-b43a23840970 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:55.545204 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06d601fd-983e-4487-8420-b43a23840970 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:55.546194 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06d601fd-983e-4487-8420-b43a23840970 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:55.546804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06d601fd-983e-4487-8420-b43a23840970 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:55.583787 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-06d601fd-983e-4487-8420-b43a23840970 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055044 Jun 16 18:17:55.584607 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 520/1041] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Jun 16 18:17:55 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:17:55.653231 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5f73b3fb-c728-4f14-929c-111453f47475 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:55.654996 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5f73b3fb-c728-4f14-929c-111453f47475 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:55.676375 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:17:55.676375 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5f73b3fb-c728-4f14-929c-111453f47475 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:55.676375 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5f73b3fb-c728-4f14-929c-111453f47475 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:55.676375 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5f73b3fb-c728-4f14-929c-111453f47475 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:55.676790 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5f73b3fb-c728-4f14-929c-111453f47475 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:55.710451 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5f73b3fb-c728-4f14-929c-111453f47475 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Going to try to terminate instance {{(pid=118161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:17:56.493857 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5f73b3fb-c728-4f14-929c-111453f47475 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 204 len: 0 microversion: 2.20 time: 0.846269 Jun 16 18:17:56.494920 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 522/1042] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Jun 16 18:17:55 2022] DELETE /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 18:17:56.503557 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dd9acfaf-a334-41ea-8426-9e366ec19bd2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:56.504180 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-dd9acfaf-a334-41ea-8426-9e366ec19bd2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:56.512622 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dd9acfaf-a334-41ea-8426-9e366ec19bd2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:56.513171 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dd9acfaf-a334-41ea-8426-9e366ec19bd2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:56.514822 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dd9acfaf-a334-41ea-8426-9e366ec19bd2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:56.514822 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dd9acfaf-a334-41ea-8426-9e366ec19bd2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:56.671518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dd9acfaf-a334-41ea-8426-9e366ec19bd2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:56.680405 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dd9acfaf-a334-41ea-8426-9e366ec19bd2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:56.681901 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dd9acfaf-a334-41ea-8426-9e366ec19bd2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:56.683073 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-dd9acfaf-a334-41ea-8426-9e366ec19bd2 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.183549 Jun 16 18:17:56.683647 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 521/1043] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:17:56 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:17:57.703179 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6ebd44a6-98d2-4afe-a59d-010d0b859c73 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:57.704098 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6ebd44a6-98d2-4afe-a59d-010d0b859c73 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:57.711874 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6ebd44a6-98d2-4afe-a59d-010d0b859c73 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:57.712397 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6ebd44a6-98d2-4afe-a59d-010d0b859c73 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:57.713115 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6ebd44a6-98d2-4afe-a59d-010d0b859c73 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:57.713550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6ebd44a6-98d2-4afe-a59d-010d0b859c73 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:57.896036 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6ebd44a6-98d2-4afe-a59d-010d0b859c73 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:57.906873 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6ebd44a6-98d2-4afe-a59d-010d0b859c73 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:57.909957 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6ebd44a6-98d2-4afe-a59d-010d0b859c73 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:57.911962 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6ebd44a6-98d2-4afe-a59d-010d0b859c73 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.212534 Jun 16 18:17:57.913063 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 523/1044] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:17:57 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:17:58.934972 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-58f2d645-5c2f-432c-98d2-f24315ef4994 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:17:58.935851 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-58f2d645-5c2f-432c-98d2-f24315ef4994 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:17:58.947578 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-58f2d645-5c2f-432c-98d2-f24315ef4994 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:58.948039 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-58f2d645-5c2f-432c-98d2-f24315ef4994 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:58.948886 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-58f2d645-5c2f-432c-98d2-f24315ef4994 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:17:58.949326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-58f2d645-5c2f-432c-98d2-f24315ef4994 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:17:59.105207 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-58f2d645-5c2f-432c-98d2-f24315ef4994 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:59.112497 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-58f2d645-5c2f-432c-98d2-f24315ef4994 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:59.114058 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-58f2d645-5c2f-432c-98d2-f24315ef4994 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:17:59.119023 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-58f2d645-5c2f-432c-98d2-f24315ef4994 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1724 microversion: 2.20 time: 0.188459 Jun 16 18:17:59.120015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 522/1045] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:17:58 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:18:00.070529 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-1307ab28-08e0-4659-b794-21492f153ded req-2c06fe9c-3ff6-4737-9960-3937034a1d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4792d5b1-2139-4dc1-b191-7975b01fc093", "name": "network-vif-deleted", "tag": "7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:00.079912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-1307ab28-08e0-4659-b794-21492f153ded req-2c06fe9c-3ff6-4737-9960-3937034a1d98 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:00.080479 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-1307ab28-08e0-4659-b794-21492f153ded req-2c06fe9c-3ff6-4737-9960-3937034a1d98 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:00.094249 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-1307ab28-08e0-4659-b794-21492f153ded req-2c06fe9c-3ff6-4737-9960-3937034a1d98 service nova] Creating event network-vif-deleted:7dfa4018-4ed0-4e6c-acc0-dde32ca8db6e for instance 4792d5b1-2139-4dc1-b191-7975b01fc093 on hv-cinder-83754 Jun 16 18:18:00.100628 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-1307ab28-08e0-4659-b794-21492f153ded req-2c06fe9c-3ff6-4737-9960-3937034a1d98 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227711 Jun 16 18:18:00.113632 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 524/1046] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:00.141130 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dde686a6-327b-40a3-bc0e-e83f6e1d6570 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:00.141779 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-dde686a6-327b-40a3-bc0e-e83f6e1d6570 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:18:00.149002 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dde686a6-327b-40a3-bc0e-e83f6e1d6570 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:00.170182 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dde686a6-327b-40a3-bc0e-e83f6e1d6570 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:00.170182 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dde686a6-327b-40a3-bc0e-e83f6e1d6570 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:00.170182 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dde686a6-327b-40a3-bc0e-e83f6e1d6570 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:00.222363 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dde686a6-327b-40a3-bc0e-e83f6e1d6570 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:18:00.231394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dde686a6-327b-40a3-bc0e-e83f6e1d6570 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:18:00.232988 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-dde686a6-327b-40a3-bc0e-e83f6e1d6570 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:18:00.234184 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-dde686a6-327b-40a3-bc0e-e83f6e1d6570 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1656 microversion: 2.20 time: 0.097845 Jun 16 18:18:00.234749 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 523/1047] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:18:00 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1656 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:18:01.257970 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:01.257970 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:18:01.265494 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:01.266014 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:01.266876 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:01.267401 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:01.302303 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:01.303019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:01.303628 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lazy-loading 'fault' on Instance uuid 4792d5b1-2139-4dc1-b191-7975b01fc093 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:18:01.385418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:18:01.394974 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:18:01.397152 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30ac12728e8f4ec9af534612030d75eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11089493792047939c9f45f632a0ce05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:18:01.398551 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-bd688d97-26ab-4f06-8305-705bd945038d tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 200 len: 1371 microversion: 2.20 time: 0.148486 Jun 16 18:18:01.399195 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 525/1048] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:18:01 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:18:02.426228 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3e92300c-2697-411e-b842-09fd1975b2c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:02.428000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3e92300c-2697-411e-b842-09fd1975b2c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:18:02.435318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e92300c-2697-411e-b842-09fd1975b2c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:02.435796 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e92300c-2697-411e-b842-09fd1975b2c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:02.436780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e92300c-2697-411e-b842-09fd1975b2c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:02.437222 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e92300c-2697-411e-b842-09fd1975b2c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:02.454512 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-3e92300c-2697-411e-b842-09fd1975b2c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] HTTP exception thrown: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3e92300c-2697-411e-b842-09fd1975b2c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Request method failure captured: Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 HTTP/1.1 Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E0DLFAzueFCRyIOI_Wamcopl8BPhZjhyXF5i3gaLx65IHRBB3NLvtjkKNFypU4raCiEo3zxARXdw3R8WCKDEUqiKq7KT-reEK7LcUQCbH2ITH7OzfsKqzEUI8VK4v2Pf3oENG-wt4cY3NFptHmG70LNOTwWOmDqhut9bWDnW3uRAo Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 11089493792047939c9f45f632a0ce05 Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:18:02.456404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:18:02.458250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11089493792047939c9f45f632a0ce05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11089493792047939c9f45f632a0ce05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11089493792047939c9f45f632a0ce05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11089493792047939c9f45f632a0ce05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:18:02.458250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:02.458250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 11089493792047939c9f45f632a0ce05 Jun 16 18:18:02.458250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:02.458250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeShelveTestJSON-1970635677-project Jun 16 18:18:02.458250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:18:02.458250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:18:02.458250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 30ac12728e8f4ec9af534612030d75eb Jun 16 18:18:02.458250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1970635677-project Jun 16 18:18:02.458250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:18:02.458250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:02.458250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '4792d5b1-2139-4dc1-b191-7975b01fc093'} Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:02.459166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:02.460656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:02.462802 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3e92300c-2697-411e-b842-09fd1975b2c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Returning 404 to user: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:02.463697 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3e92300c-2697-411e-b842-09fd1975b2c5 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 404 len: 111 microversion: 2.20 time: 0.042156 Jun 16 18:18:02.464268 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 524/1049] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:18:02 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:18:02.473008 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ed3f18f7-6291-488a-9708-2b94bc314257 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '.version_select at 0x7f9c304b7dc0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:02.672472 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ed3f18f7-6291-488a-9708-2b94bc314257 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-678770000" status: 204 len: 0 microversion: 2.20 time: 0.203413 Jun 16 18:18:02.673057 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 526/1050] 10.222.0.58 () {60 vars in 1258 bytes} [Thu Jun 16 18:18:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-678770000 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 18:18:05.207930 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-25bea917-e7dd-4722-b81a-ba27cd1ffa6f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:05.208479 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-25bea917-e7dd-4722-b81a-ba27cd1ffa6f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:18:05.223873 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-25bea917-e7dd-4722-b81a-ba27cd1ffa6f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:05.224008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-25bea917-e7dd-4722-b81a-ba27cd1ffa6f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:05.225554 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-25bea917-e7dd-4722-b81a-ba27cd1ffa6f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:05.225554 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-25bea917-e7dd-4722-b81a-ba27cd1ffa6f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:05.246789 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-25bea917-e7dd-4722-b81a-ba27cd1ffa6f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] HTTP exception thrown: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-25bea917-e7dd-4722-b81a-ba27cd1ffa6f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Request method failure captured: Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: DELETE /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 HTTP/1.1 Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E0DLFAzueFCRyIOI_Wamcopl8BPhZjhyXF5i3gaLx65IHRBB3NLvtjkKNFypU4raCiEo3zxARXdw3R8WCKDEUqiKq7KT-reEK7LcUQCbH2ITH7OzfsKqzEUI8VK4v2Pf3oENG-wt4cY3NFptHmG70LNOTwWOmDqhut9bWDnW3uRAo Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 11089493792047939c9f45f632a0ce05 Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:18:05.249444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:18:05.252387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11089493792047939c9f45f632a0ce05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11089493792047939c9f45f632a0ce05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11089493792047939c9f45f632a0ce05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11089493792047939c9f45f632a0ce05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:18:05.252387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:05.252387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 11089493792047939c9f45f632a0ce05 Jun 16 18:18:05.252387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:05.252387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeShelveTestJSON-1970635677-project Jun 16 18:18:05.252387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:18:05.252387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:18:05.252387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 30ac12728e8f4ec9af534612030d75eb Jun 16 18:18:05.252387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1970635677-project Jun 16 18:18:05.252387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:18:05.252387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:05.252387 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '4792d5b1-2139-4dc1-b191-7975b01fc093'} Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:05.253782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:05.257610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:05.259933 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-25bea917-e7dd-4722-b81a-ba27cd1ffa6f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Returning 404 to user: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:05.259933 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-25bea917-e7dd-4722-b81a-ba27cd1ffa6f tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 404 len: 111 microversion: 2.20 time: 0.047448 Jun 16 18:18:05.259933 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 525/1051] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Jun 16 18:18:05 2022] DELETE /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:18:05.263192 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-34a62047-509d-4494-b01b-6ed404da4cfa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:05.264024 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-34a62047-509d-4494-b01b-6ed404da4cfa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 4792d5b1-2139-4dc1-b191-7975b01fc093] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:18:05.276089 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-34a62047-509d-4494-b01b-6ed404da4cfa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:05.277060 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-34a62047-509d-4494-b01b-6ed404da4cfa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:05.277616 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-34a62047-509d-4494-b01b-6ed404da4cfa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:05.278056 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-34a62047-509d-4494-b01b-6ed404da4cfa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:05.300163 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-34a62047-509d-4494-b01b-6ed404da4cfa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] HTTP exception thrown: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-34a62047-509d-4494-b01b-6ed404da4cfa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Request method failure captured: Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 HTTP/1.1 Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3E0DLFAzueFCRyIOI_Wamcopl8BPhZjhyXF5i3gaLx65IHRBB3NLvtjkKNFypU4raCiEo3zxARXdw3R8WCKDEUqiKq7KT-reEK7LcUQCbH2ITH7OzfsKqzEUI8VK4v2Pf3oENG-wt4cY3NFptHmG70LNOTwWOmDqhut9bWDnW3uRAo Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 11089493792047939c9f45f632a0ce05 Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:18:05.301890 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:18:05.305088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11089493792047939c9f45f632a0ce05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11089493792047939c9f45f632a0ce05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11089493792047939c9f45f632a0ce05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11089493792047939c9f45f632a0ce05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:18:05.305088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:05.305088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 11089493792047939c9f45f632a0ce05 Jun 16 18:18:05.305088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:05.305088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-AttachVolumeShelveTestJSON-1970635677-project Jun 16 18:18:05.305088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:18:05.305088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:18:05.305088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 30ac12728e8f4ec9af534612030d75eb Jun 16 18:18:05.305088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1970635677-project Jun 16 18:18:05.305088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:18:05.305088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:05.305088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '4792d5b1-2139-4dc1-b191-7975b01fc093'} Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:05.306453 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. Jun 16 18:18:05.309928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:05.315594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-34a62047-509d-4494-b01b-6ed404da4cfa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Returning 404 to user: Instance 4792d5b1-2139-4dc1-b191-7975b01fc093 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:05.315594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-34a62047-509d-4494-b01b-6ed404da4cfa tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093" status: 404 len: 111 microversion: 2.20 time: 0.045481 Jun 16 18:18:05.315594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 527/1052] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:18:05 2022] GET /compute/v2.1/servers/4792d5b1-2139-4dc1-b191-7975b01fc093 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:18:06.725545 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-997706ff-24c0-4b75-85b4-f677fb877feb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:06.726678 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-997706ff-24c0-4b75-85b4-f677fb877feb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:18:06.750832 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-997706ff-24c0-4b75-85b4-f677fb877feb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:06.751535 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-997706ff-24c0-4b75-85b4-f677fb877feb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:06.752587 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-997706ff-24c0-4b75-85b4-f677fb877feb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:06.753154 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-997706ff-24c0-4b75-85b4-f677fb877feb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:06.779293 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-997706ff-24c0-4b75-85b4-f677fb877feb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] HTTP exception thrown: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-997706ff-24c0-4b75-85b4-f677fb877feb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Request method failure captured: Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: DELETE /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 HTTP/1.1 Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3E0DLFAzueFCRyIOI_Wamcopl8BPhZjhyXF5i3gaLx65IHRBB3NLvtjkKNFypU4raCiEo3zxARXdw3R8WCKDEUqiKq7KT-reEK7LcUQCbH2ITH7OzfsKqzEUI8VK4v2Pf3oENG-wt4cY3NFptHmG70LNOTwWOmDqhut9bWDnW3uRAo Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 11089493792047939c9f45f632a0ce05 Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:18:06.782458 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:18:06.789713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11089493792047939c9f45f632a0ce05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11089493792047939c9f45f632a0ce05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11089493792047939c9f45f632a0ce05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11089493792047939c9f45f632a0ce05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:18:06.789713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:06.789713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 11089493792047939c9f45f632a0ce05 Jun 16 18:18:06.789713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:06.789713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-AttachVolumeShelveTestJSON-1970635677-project Jun 16 18:18:06.789713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:18:06.789713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:18:06.789713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 30ac12728e8f4ec9af534612030d75eb Jun 16 18:18:06.789713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1970635677-project Jun 16 18:18:06.789713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:18:06.789713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:18:06.789713 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '279175ca-aad1-40da-a191-4712cbd17771'} Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:06.790774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:18:06.792079 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:06.793327 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-997706ff-24c0-4b75-85b4-f677fb877feb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Returning 404 to user: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:06.793327 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-997706ff-24c0-4b75-85b4-f677fb877feb tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "DELETE /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 404 len: 111 microversion: 2.20 time: 0.067238 Jun 16 18:18:06.793327 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 526/1053] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Jun 16 18:18:06 2022] DELETE /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:18:06.798269 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c36cf405-b660-4db5-8112-2b85a8db6407 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:06.799159 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c36cf405-b660-4db5-8112-2b85a8db6407 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] [instance: 279175ca-aad1-40da-a191-4712cbd17771] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:18:06.809815 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c36cf405-b660-4db5-8112-2b85a8db6407 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:06.810359 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c36cf405-b660-4db5-8112-2b85a8db6407 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:06.811436 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c36cf405-b660-4db5-8112-2b85a8db6407 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:06.812035 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c36cf405-b660-4db5-8112-2b85a8db6407 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:06.832161 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-c36cf405-b660-4db5-8112-2b85a8db6407 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] HTTP exception thrown: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c36cf405-b660-4db5-8112-2b85a8db6407 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Request method failure captured: Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 HTTP/1.1 Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3E0DLFAzueFCRyIOI_Wamcopl8BPhZjhyXF5i3gaLx65IHRBB3NLvtjkKNFypU4raCiEo3zxARXdw3R8WCKDEUqiKq7KT-reEK7LcUQCbH2ITH7OzfsKqzEUI8VK4v2Pf3oENG-wt4cY3NFptHmG70LNOTwWOmDqhut9bWDnW3uRAo Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 11089493792047939c9f45f632a0ce05 Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:18:06.834448 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:18:06.836273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_11089493792047939c9f45f632a0ce05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11089493792047939c9f45f632a0ce05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/11089493792047939c9f45f632a0ce05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/11089493792047939c9f45f632a0ce05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:18:06.836273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:06.836273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 11089493792047939c9f45f632a0ce05 Jun 16 18:18:06.836273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1970635677 Jun 16 18:18:06.836273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-AttachVolumeShelveTestJSON-1970635677-project Jun 16 18:18:06.836273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:18:06.836273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:18:06.836273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 30ac12728e8f4ec9af534612030d75eb Jun 16 18:18:06.836273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1970635677-project Jun 16 18:18:06.836273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:18:06.836273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:18:06.836273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '279175ca-aad1-40da-a191-4712cbd17771'} Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:06.837178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. Jun 16 18:18:06.838701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:06.840676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c36cf405-b660-4db5-8112-2b85a8db6407 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] Returning 404 to user: Instance 279175ca-aad1-40da-a191-4712cbd17771 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:06.840676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c36cf405-b660-4db5-8112-2b85a8db6407 tempest-AttachVolumeShelveTestJSON-1970635677 tempest-AttachVolumeShelveTestJSON-1970635677-project] 10.222.0.58 "GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771" status: 404 len: 111 microversion: 2.20 time: 0.046946 Jun 16 18:18:06.840676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 528/1054] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Jun 16 18:18:06 2022] GET /compute/v2.1/servers/279175ca-aad1-40da-a191-4712cbd17771 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 18:18:14.019324 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d057a019-cdf4-42b6-80bb-19e88a47739b tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Action: 'create', calling method: .version_select at 0x7f9c23d1f310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1386395826"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:14.888472 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d057a019-cdf4-42b6-80bb-19e88a47739b tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.003739 Jun 16 18:18:14.889119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 527/1055] 10.222.0.58 () {60 vars in 1154 bytes} [Thu Jun 16 18:18:13 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1005 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 18:18:14.901466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-cd282075-0aca-4645-8188-ec8dbf0e677f tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c3048b310>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:14.955077 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-cd282075-0aca-4645-8188-ec8dbf0e677f tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc" status: 200 len: 345 microversion: 2.1 time: 0.058280 Jun 16 18:18:14.955754 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 529/1056] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:18:14 2022] GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:15.969006 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1c4e78d1-94bd-41d3-9df1-bd53bf54bc72 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c23ca55e0>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:16.019752 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1c4e78d1-94bd-41d3-9df1-bd53bf54bc72 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc" status: 200 len: 345 microversion: 2.1 time: 0.055085 Jun 16 18:18:16.020307 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 528/1057] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:18:15 2022] GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:17.029436 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:18:17.030215 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:18:17.034104 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-11a02994-4425-4a8c-8294-cb9ec5c166ac tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c304b75e0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:17.084734 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-11a02994-4425-4a8c-8294-cb9ec5c166ac tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc" status: 200 len: 345 microversion: 2.1 time: 0.056515 Jun 16 18:18:17.085310 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 530/1058] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:18:17 2022] GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:18.094649 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=13 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:18:18.095490 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=52 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:18:18.100522 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-769a3a25-e078-4c18-8bae-ab4edc9921e4 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c23cd8280>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:18.150892 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-769a3a25-e078-4c18-8bae-ab4edc9921e4 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc" status: 200 len: 345 microversion: 2.1 time: 0.057170 Jun 16 18:18:18.151668 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 529/1059] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:18:18 2022] GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:19.170323 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-090a211e-d4b6-449e-b2f3-237f9eede0fd tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c30540700>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:19.231275 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-090a211e-d4b6-449e-b2f3-237f9eede0fd tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc" status: 200 len: 346 microversion: 2.1 time: 0.069801 Jun 16 18:18:19.232343 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 531/1060] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:18:19 2022] GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:19.248101 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d054ec02-4e66-48bb-8d73-86cd1e9e0062 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Action: 'create', calling method: .version_select at 0x7f9c23d1f0d0>, body: {"snapshot": {"volume_id": "88858122-46a2-4948-8a20-73076026b4cc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1766442348"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:19.765491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d054ec02-4e66-48bb-8d73-86cd1e9e0062 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.522457 Jun 16 18:18:19.766233 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 530/1061] 10.222.0.58 () {60 vars in 1161 bytes} [Thu Jun 16 18:18:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:19.777061 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-98c6daf9-4372-4528-b7bf-27a0bae22a67 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c3062cee0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:19.820615 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-98c6daf9-4372-4528-b7bf-27a0bae22a67 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 200 len: 287 microversion: 2.1 time: 0.048552 Jun 16 18:18:19.822265 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 532/1062] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:19 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:19.831647 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8c8b807e-2ef3-44c1-b2c3-6f29c2a1e8bc tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c23d1fa60>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:19.869336 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8c8b807e-2ef3-44c1-b2c3-6f29c2a1e8bc tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.041681 Jun 16 18:18:19.870173 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 531/1063] 10.222.0.58 () {58 vars in 1139 bytes} [Thu Jun 16 18:18:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:19.881920 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-20355ed3-9ee7-4fd0-b8be-914fee8ee1f3 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c304b7280>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:19.913741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-20355ed3-9ee7-4fd0-b8be-914fee8ee1f3 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 200 len: 287 microversion: 2.1 time: 0.036308 Jun 16 18:18:19.914360 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 533/1064] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:19 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:20.927456 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e934d8e6-9504-45c9-bd40-436deb7529e0 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c23c85790>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:20.964935 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e934d8e6-9504-45c9-bd40-436deb7529e0 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 200 len: 287 microversion: 2.1 time: 0.042455 Jun 16 18:18:20.965532 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 532/1065] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:20 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:21.977878 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d7b3e0f1-d214-4d63-b9ba-f7c03d65e5fa tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c3051f9d0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:22.013697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d7b3e0f1-d214-4d63-b9ba-f7c03d65e5fa tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 200 len: 287 microversion: 2.1 time: 0.040318 Jun 16 18:18:22.014548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 534/1066] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:21 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:18:23.028560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-90b555ad-5160-43ac-a903-438f4bde24b6 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c23b925e0>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:23.072225 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-90b555ad-5160-43ac-a903-438f4bde24b6 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 200 len: 287 microversion: 2.1 time: 0.049731 Jun 16 18:18:23.072938 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 533/1067] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:23 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:24.087668 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3669d842-27c5-48c3-8f68-c99cf88bb320 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c30644700>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:24.123088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3669d842-27c5-48c3-8f68-c99cf88bb320 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 200 len: 287 microversion: 2.1 time: 0.040010 Jun 16 18:18:24.123883 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 535/1068] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:24 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:25.135037 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f603346e-3139-4d26-b246-6845e3f0e774 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c23cd8b80>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:25.167601 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f603346e-3139-4d26-b246-6845e3f0e774 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 200 len: 287 microversion: 2.1 time: 0.037224 Jun 16 18:18:25.168169 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 534/1069] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:25 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:26.182608 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-785f7de4-b50f-4d77-8de2-1c9260731ff4 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c30540160>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:26.212455 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-785f7de4-b50f-4d77-8de2-1c9260731ff4 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 200 len: 287 microversion: 2.1 time: 0.034796 Jun 16 18:18:26.213019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 536/1070] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:26 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:27.224805 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4c72c30a-871e-4988-9148-abd02178418c tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c23d1f280>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:27.255036 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4c72c30a-871e-4988-9148-abd02178418c tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 200 len: 287 microversion: 2.1 time: 0.034554 Jun 16 18:18:27.255768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 535/1071] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:27 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:28.267545 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-50689967-2212-4c33-b807-f69e7275dc36 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c30677af0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:28.300137 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-50689967-2212-4c33-b807-f69e7275dc36 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 200 len: 287 microversion: 2.1 time: 0.036944 Jun 16 18:18:28.300758 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 537/1072] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:28 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:29.314688 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a80ed758-d8b5-4104-88e9-5b6e44a645be tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c23c8c670>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:29.349299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a80ed758-d8b5-4104-88e9-5b6e44a645be tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 200 len: 288 microversion: 2.1 time: 0.039949 Jun 16 18:18:29.349956 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 536/1073] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:29 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:29.361716 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-06362cf7-c4f7-43fc-b5b1-9d5fea475969 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c304de3a0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:29.569121 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-06362cf7-c4f7-43fc-b5b1-9d5fea475969 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 202 len: 0 microversion: 2.1 time: 0.211665 Jun 16 18:18:29.569756 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 538/1074] 10.222.0.58 () {58 vars in 1253 bytes} [Thu Jun 16 18:18:29 2022] DELETE /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:18:29.578568 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-35c90c04-7ba5-4d40-b2f5-c9ec951bad8b tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c23d1f310>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:29.609183 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-35c90c04-7ba5-4d40-b2f5-c9ec951bad8b tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 200 len: 287 microversion: 2.1 time: 0.034918 Jun 16 18:18:29.615247 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 537/1075] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:29 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:30.629621 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2803acf6-58f0-4942-a9a1-d92f35977c8d tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c30551160>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:30.660958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-2803acf6-58f0-4942-a9a1-d92f35977c8d tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] HTTP exception thrown: Snapshot 1644a3e1-c467-47dc-9f34-1f24a1116ab0 could not be found. Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2803acf6-58f0-4942-a9a1-d92f35977c8d tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Request method failure captured: Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 HTTP/1.1 Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3Pl1beoNSbEnnnbMXFr6yoRFYdbIWLRVSs-wb1XEhTsbAwknG3Zc6c1QtEgiwNXS5OcKaNo5MoX46afockn5A893Tz_7kjNLyCUuKR425OPsra3nlqXbNsUET44H3RWs-Dmg2LKJAphpPkcwgXa0fPcQ2iiCFuAfxfjSjF67oa9Zyg Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: bc410a7799824e04893aa6d547228687 Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-624257852 Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:18:30.663252 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc410a7799824e04893aa6d547228687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc410a7799824e04893aa6d547228687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc410a7799824e04893aa6d547228687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc410a7799824e04893aa6d547228687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-VolumesSnapshotsTestJSON-624257852 Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: bc410a7799824e04893aa6d547228687 Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-624257852 Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-VolumesSnapshotsTestJSON-624257852-project Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 1dca25b8a07f46bab05f8574cbeb56e7 Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-VolumesSnapshotsTestJSON-624257852-project Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Snapshot 1644a3e1-c467-47dc-9f34-1f24a1116ab0 could not be found. Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '1644a3e1-c467-47dc-9f34-1f24a1116ab0'} Jun 16 18:18:30.665043 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1644a3e1-c467-47dc-9f34-1f24a1116ab0 could not be found. (HTTP 404) (Request-ID: req-08b50029-7876-4975-8366-8da60dae48e6) Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:30.666605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:18:30.668058 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1644a3e1-c467-47dc-9f34-1f24a1116ab0 could not be found. Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 18:18:30.669637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1644a3e1-c467-47dc-9f34-1f24a1116ab0 could not be found. Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1644a3e1-c467-47dc-9f34-1f24a1116ab0 could not be found. Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2803acf6-58f0-4942-a9a1-d92f35977c8d tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Returning 404 to user: Snapshot 1644a3e1-c467-47dc-9f34-1f24a1116ab0 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:30.671187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2803acf6-58f0-4942-a9a1-d92f35977c8d tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0" status: 404 len: 111 microversion: 2.1 time: 0.042915 Jun 16 18:18:30.672325 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 539/1076] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Jun 16 18:18:30 2022] GET /compute/v2.1/os-snapshots/1644a3e1-c467-47dc-9f34-1f24a1116ab0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:18:30.675115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4a1d009b-78ea-4f95-aa06-c9a4520949af tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c23cc8790>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:31.033019 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4a1d009b-78ea-4f95-aa06-c9a4520949af tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc" status: 202 len: 0 microversion: 2.1 time: 0.362367 Jun 16 18:18:31.033956 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 538/1077] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jun 16 18:18:30 2022] DELETE /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:18:31.045276 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-24c1a709-9dc9-4e91-8fbb-22dd0976fc5c tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c30551280>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:31.106915 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-24c1a709-9dc9-4e91-8fbb-22dd0976fc5c tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc" status: 200 len: 345 microversion: 2.1 time: 0.068184 Jun 16 18:18:31.113688 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 540/1078] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:18:31 2022] GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:18:32.126618 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-06d181d2-fb31-4a4c-afb4-018a6774a2b9 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c23d743a0>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:32.159063 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-06d181d2-fb31-4a4c-afb4-018a6774a2b9 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] HTTP exception thrown: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-06d181d2-fb31-4a4c-afb4-018a6774a2b9 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Request method failure captured: Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc HTTP/1.1 Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3Pl1beoNSbEnnnbMXFr6yoRFYdbIWLRVSs-wb1XEhTsbAwknG3Zc6c1QtEgiwNXS5OcKaNo5MoX46afockn5A893Tz_7kjNLyCUuKR425OPsra3nlqXbNsUET44H3RWs-Dmg2LKJAphpPkcwgXa0fPcQ2iiCFuAfxfjSjF67oa9Zyg Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: bc410a7799824e04893aa6d547228687 Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-624257852 Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:18:32.161299 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc410a7799824e04893aa6d547228687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc410a7799824e04893aa6d547228687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc410a7799824e04893aa6d547228687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc410a7799824e04893aa6d547228687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-VolumesSnapshotsTestJSON-624257852 Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: bc410a7799824e04893aa6d547228687 Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-624257852 Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-VolumesSnapshotsTestJSON-624257852-project Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 1dca25b8a07f46bab05f8574cbeb56e7 Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-VolumesSnapshotsTestJSON-624257852-project Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '88858122-46a2-4948-8a20-73076026b4cc'} Jun 16 18:18:32.164140 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. (HTTP 404) (Request-ID: req-18425fac-48e3-4411-9431-a96c27461d9d) Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:32.165205 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:18:32.168727 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:18:32.171903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-06d181d2-fb31-4a4c-afb4-018a6774a2b9 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Returning 404 to user: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:32.175068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-06d181d2-fb31-4a4c-afb4-018a6774a2b9 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc" status: 404 len: 109 microversion: 2.1 time: 0.040825 Jun 16 18:18:32.179219 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 539/1079] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:18:32 2022] GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:18:32.186782 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-62a237de-39ec-4dc1-9703-0d99e4329a04 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c304b73a0>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:32.215796 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-62a237de-39ec-4dc1-9703-0d99e4329a04 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] HTTP exception thrown: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-62a237de-39ec-4dc1-9703-0d99e4329a04 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Request method failure captured: Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: DELETE /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc HTTP/1.1 Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3Pl1beoNSbEnnnbMXFr6yoRFYdbIWLRVSs-wb1XEhTsbAwknG3Zc6c1QtEgiwNXS5OcKaNo5MoX46afockn5A893Tz_7kjNLyCUuKR425OPsra3nlqXbNsUET44H3RWs-Dmg2LKJAphpPkcwgXa0fPcQ2iiCFuAfxfjSjF67oa9Zyg Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: bc410a7799824e04893aa6d547228687 Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-624257852 Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:18:32.217743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc410a7799824e04893aa6d547228687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc410a7799824e04893aa6d547228687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc410a7799824e04893aa6d547228687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc410a7799824e04893aa6d547228687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-VolumesSnapshotsTestJSON-624257852 Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: bc410a7799824e04893aa6d547228687 Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-624257852 Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-VolumesSnapshotsTestJSON-624257852-project Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 1dca25b8a07f46bab05f8574cbeb56e7 Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-VolumesSnapshotsTestJSON-624257852-project Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '88858122-46a2-4948-8a20-73076026b4cc'} Jun 16 18:18:32.219550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. (HTTP 404) (Request-ID: req-ac292455-0a5e-4cf6-99dd-545e987006e9) Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:32.220645 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:18:32.222244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 18:18:32.224075 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-62a237de-39ec-4dc1-9703-0d99e4329a04 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Returning 404 to user: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-62a237de-39ec-4dc1-9703-0d99e4329a04 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc" status: 404 len: 109 microversion: 2.1 time: 0.039955 Jun 16 18:18:32.225506 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 541/1080] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Jun 16 18:18:32 2022] DELETE /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:18:32.227878 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9eb2667c-be43-47fa-9bf7-7016ea231439 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Calling method '.version_select at 0x7f9c23c8cb80>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:32.263489 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-9eb2667c-be43-47fa-9bf7-7016ea231439 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] HTTP exception thrown: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9eb2667c-be43-47fa-9bf7-7016ea231439 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Request method failure captured: Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc HTTP/1.1 Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3Pl1beoNSbEnnnbMXFr6yoRFYdbIWLRVSs-wb1XEhTsbAwknG3Zc6c1QtEgiwNXS5OcKaNo5MoX46afockn5A893Tz_7kjNLyCUuKR425OPsra3nlqXbNsUET44H3RWs-Dmg2LKJAphpPkcwgXa0fPcQ2iiCFuAfxfjSjF67oa9Zyg Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: bc410a7799824e04893aa6d547228687 Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-624257852 Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:18:32.267003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc410a7799824e04893aa6d547228687"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc410a7799824e04893aa6d547228687"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc410a7799824e04893aa6d547228687"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc410a7799824e04893aa6d547228687"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-VolumesSnapshotsTestJSON-624257852 Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: bc410a7799824e04893aa6d547228687 Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-624257852 Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-VolumesSnapshotsTestJSON-624257852-project Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 1dca25b8a07f46bab05f8574cbeb56e7 Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-VolumesSnapshotsTestJSON-624257852-project Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '88858122-46a2-4948-8a20-73076026b4cc'} Jun 16 18:18:32.271968 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. (HTTP 404) (Request-ID: req-1d05f81d-f1e2-45da-93a0-e704f0794b96) Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:32.272970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:18:32.274375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:18:32.276211 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9eb2667c-be43-47fa-9bf7-7016ea231439 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] Returning 404 to user: Volume 88858122-46a2-4948-8a20-73076026b4cc could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9eb2667c-be43-47fa-9bf7-7016ea231439 tempest-VolumesSnapshotsTestJSON-624257852 tempest-VolumesSnapshotsTestJSON-624257852-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc" status: 404 len: 109 microversion: 2.1 time: 0.043767 Jun 16 18:18:32.277645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 540/1081] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Jun 16 18:18:32 2022] GET /compute/v2.1/os-volumes/88858122-46a2-4948-8a20-73076026b4cc => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:18:55.051299 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-749849745", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "networks": [{"uuid": "fed4a843-c424-41d3-92ff-8a52b736d0b6"}]}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:18:55.105061 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] validate_networks() for [('fed4a843-c424-41d3-92ff-8a52b736d0b6', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:18:55.529659 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:18:55.530076 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:18:55.530541 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:18:55.530947 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:18:55.531347 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:18:55.540381 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:55.540754 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:55.542130 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:55.542562 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:55.561811 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Getting quotas for project c3974a2bdfca4093986a7ca6cd926d58. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:18:55.567772 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Getting quotas for user 4fca3484e66343849b9efcd87c17b1ac and project c3974a2bdfca4093986a7ca6cd926d58. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:18:55.580115 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:18:55.582431 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:18:55.711521 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-fc19d2de-32af-4a8a-a99f-513bb20d96e1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665256 Jun 16 18:18:55.717785 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 542/1082] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:18:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:18:55.725521 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e9249ada-6fa4-4b03-bced-c84b25b96cca tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:55.726469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e9249ada-6fa4-4b03-bced-c84b25b96cca tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:18:55.786417 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e9249ada-6fa4-4b03-bced-c84b25b96cca tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:18:55.794060 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e9249ada-6fa4-4b03-bced-c84b25b96cca tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1218 microversion: 2.1 time: 0.074669 Jun 16 18:18:55.794555 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 541/1083] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:18:55 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:18:56.814489 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f219654b-1572-4bc4-b6dd-b676dfd4d251 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:56.815172 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f219654b-1572-4bc4-b6dd-b676dfd4d251 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:18:56.823280 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f219654b-1572-4bc4-b6dd-b676dfd4d251 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:56.823882 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f219654b-1572-4bc4-b6dd-b676dfd4d251 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:56.825046 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f219654b-1572-4bc4-b6dd-b676dfd4d251 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:56.825497 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f219654b-1572-4bc4-b6dd-b676dfd4d251 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:56.897249 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f219654b-1572-4bc4-b6dd-b676dfd4d251 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:18:56.910195 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f219654b-1572-4bc4-b6dd-b676dfd4d251 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1222 microversion: 2.1 time: 0.100526 Jun 16 18:18:56.910712 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 543/1084] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:18:56 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:18:57.928843 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b619e678-a07d-40d5-999b-d1078987ad04 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:57.929455 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b619e678-a07d-40d5-999b-d1078987ad04 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:18:57.936823 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b619e678-a07d-40d5-999b-d1078987ad04 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:57.937268 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b619e678-a07d-40d5-999b-d1078987ad04 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:57.938027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b619e678-a07d-40d5-999b-d1078987ad04 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:57.938465 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b619e678-a07d-40d5-999b-d1078987ad04 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:58.001712 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b619e678-a07d-40d5-999b-d1078987ad04 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:18:58.009136 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b619e678-a07d-40d5-999b-d1078987ad04 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1222 microversion: 2.1 time: 0.084386 Jun 16 18:18:58.009689 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 542/1085] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:18:57 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:18:59.028761 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d3f61221-f789-4594-b074-7219ac6f719e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:18:59.029361 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d3f61221-f789-4594-b074-7219ac6f719e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:18:59.036216 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d3f61221-f789-4594-b074-7219ac6f719e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:59.036664 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d3f61221-f789-4594-b074-7219ac6f719e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:59.037429 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d3f61221-f789-4594-b074-7219ac6f719e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:18:59.037861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d3f61221-f789-4594-b074-7219ac6f719e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:18:59.109037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d3f61221-f789-4594-b074-7219ac6f719e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:18:59.121664 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d3f61221-f789-4594-b074-7219ac6f719e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1214 microversion: 2.1 time: 0.097949 Jun 16 18:18:59.122685 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 544/1086] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:18:59 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:00.139197 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4fd9db71-99f2-4a7d-9fb9-b6ab92f07ab1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:00.140196 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4fd9db71-99f2-4a7d-9fb9-b6ab92f07ab1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:00.146617 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4fd9db71-99f2-4a7d-9fb9-b6ab92f07ab1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:00.147075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4fd9db71-99f2-4a7d-9fb9-b6ab92f07ab1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:00.147885 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4fd9db71-99f2-4a7d-9fb9-b6ab92f07ab1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:00.148327 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4fd9db71-99f2-4a7d-9fb9-b6ab92f07ab1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:00.235812 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4fd9db71-99f2-4a7d-9fb9-b6ab92f07ab1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:00.243666 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4fd9db71-99f2-4a7d-9fb9-b6ab92f07ab1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1276 microversion: 2.1 time: 0.109301 Jun 16 18:19:00.247495 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 543/1087] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:00 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1276 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:01.261671 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8576113e-0a82-43fa-a96e-aaa7537e222e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:01.262296 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8576113e-0a82-43fa-a96e-aaa7537e222e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:01.269217 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8576113e-0a82-43fa-a96e-aaa7537e222e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:01.269664 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8576113e-0a82-43fa-a96e-aaa7537e222e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:01.270445 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8576113e-0a82-43fa-a96e-aaa7537e222e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:01.270882 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8576113e-0a82-43fa-a96e-aaa7537e222e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:01.420209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8576113e-0a82-43fa-a96e-aaa7537e222e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:01.428231 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8576113e-0a82-43fa-a96e-aaa7537e222e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.170778 Jun 16 18:19:01.428820 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 545/1088] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:01 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:02.005161 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-2701a1a1-8e8c-44c7-a263-a4cbe5de81a2 req-4dd0de35-3b27-4c7e-80c1-128e487ffdc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b74cf17-0efd-4f08-8a68-deb3ea646499", "tag": "1eca41c3-6e5c-433a-8853-14c1c2c804e3"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:19:02.014871 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-2701a1a1-8e8c-44c7-a263-a4cbe5de81a2 req-4dd0de35-3b27-4c7e-80c1-128e487ffdc5 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:02.015424 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-2701a1a1-8e8c-44c7-a263-a4cbe5de81a2 req-4dd0de35-3b27-4c7e-80c1-128e487ffdc5 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:02.026919 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-2701a1a1-8e8c-44c7-a263-a4cbe5de81a2 req-4dd0de35-3b27-4c7e-80c1-128e487ffdc5 service nova] Creating event network-changed:1eca41c3-6e5c-433a-8853-14c1c2c804e3 for instance 6b74cf17-0efd-4f08-8a68-deb3ea646499 on hv-cinder-83754 Jun 16 18:19:02.032768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-2701a1a1-8e8c-44c7-a263-a4cbe5de81a2 req-4dd0de35-3b27-4c7e-80c1-128e487ffdc5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031461 Jun 16 18:19:02.033397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 544/1089] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:19:02.447276 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-df85b30e-3896-4f72-9f6c-da0f8483b988 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:02.447920 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-df85b30e-3896-4f72-9f6c-da0f8483b988 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:02.455685 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-df85b30e-3896-4f72-9f6c-da0f8483b988 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:02.456135 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-df85b30e-3896-4f72-9f6c-da0f8483b988 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:02.456955 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-df85b30e-3896-4f72-9f6c-da0f8483b988 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:02.457396 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-df85b30e-3896-4f72-9f6c-da0f8483b988 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:02.604304 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-df85b30e-3896-4f72-9f6c-da0f8483b988 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:02.612633 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-df85b30e-3896-4f72-9f6c-da0f8483b988 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.170032 Jun 16 18:19:02.613203 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 546/1090] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:02 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:03.632746 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-975fe441-a92d-4c3c-86b1-0d6837054bfb tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:03.633368 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-975fe441-a92d-4c3c-86b1-0d6837054bfb tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:03.640414 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-975fe441-a92d-4c3c-86b1-0d6837054bfb tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:03.640868 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-975fe441-a92d-4c3c-86b1-0d6837054bfb tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:03.641641 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-975fe441-a92d-4c3c-86b1-0d6837054bfb tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:03.642081 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-975fe441-a92d-4c3c-86b1-0d6837054bfb tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:03.778544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-975fe441-a92d-4c3c-86b1-0d6837054bfb tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:03.786782 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-975fe441-a92d-4c3c-86b1-0d6837054bfb tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.159361 Jun 16 18:19:03.787348 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 545/1091] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:03 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:04.804716 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-eb7fe68e-22c0-4d26-97c2-4717990bceef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:04.805381 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-eb7fe68e-22c0-4d26-97c2-4717990bceef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:04.812772 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eb7fe68e-22c0-4d26-97c2-4717990bceef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:04.813222 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eb7fe68e-22c0-4d26-97c2-4717990bceef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:04.813989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eb7fe68e-22c0-4d26-97c2-4717990bceef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:04.814429 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-eb7fe68e-22c0-4d26-97c2-4717990bceef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:04.947800 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-eb7fe68e-22c0-4d26-97c2-4717990bceef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:04.956120 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-eb7fe68e-22c0-4d26-97c2-4717990bceef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.155300 Jun 16 18:19:04.956680 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 547/1092] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:04 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:05.973080 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3864e1a7-cddf-438e-9a92-21edb8495f72 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:05.974472 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3864e1a7-cddf-438e-9a92-21edb8495f72 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:05.977037 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:19:05.983855 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3864e1a7-cddf-438e-9a92-21edb8495f72 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:05.984303 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3864e1a7-cddf-438e-9a92-21edb8495f72 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:05.985078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3864e1a7-cddf-438e-9a92-21edb8495f72 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:05.985506 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3864e1a7-cddf-438e-9a92-21edb8495f72 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:06.124515 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3864e1a7-cddf-438e-9a92-21edb8495f72 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:06.137716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3864e1a7-cddf-438e-9a92-21edb8495f72 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.168397 Jun 16 18:19:06.138286 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 546/1093] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:05 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:07.155295 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7be822e7-1736-4b00-b4de-b10b80519acc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:07.156160 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7be822e7-1736-4b00-b4de-b10b80519acc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:07.157810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:19:07.158467 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=6 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:19:07.163879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7be822e7-1736-4b00-b4de-b10b80519acc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:07.164359 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7be822e7-1736-4b00-b4de-b10b80519acc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:07.165132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7be822e7-1736-4b00-b4de-b10b80519acc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:07.165595 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7be822e7-1736-4b00-b4de-b10b80519acc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:07.318561 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7be822e7-1736-4b00-b4de-b10b80519acc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:07.326427 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7be822e7-1736-4b00-b4de-b10b80519acc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.175574 Jun 16 18:19:07.327008 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 548/1094] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:07 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:08.344334 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-b101adc0-8ead-4897-8040-562cc919e903 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:08.344972 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-b101adc0-8ead-4897-8040-562cc919e903 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:08.351515 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b101adc0-8ead-4897-8040-562cc919e903 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:08.361133 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b101adc0-8ead-4897-8040-562cc919e903 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:08.361133 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b101adc0-8ead-4897-8040-562cc919e903 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:08.361133 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-b101adc0-8ead-4897-8040-562cc919e903 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:08.488402 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-b101adc0-8ead-4897-8040-562cc919e903 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:08.497107 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-b101adc0-8ead-4897-8040-562cc919e903 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.156542 Jun 16 18:19:08.498039 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 547/1095] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:08 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:09.518878 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-725101ff-e568-4e93-a204-254e1b43c761 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:09.519471 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-725101ff-e568-4e93-a204-254e1b43c761 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:09.528318 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-725101ff-e568-4e93-a204-254e1b43c761 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:09.528763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-725101ff-e568-4e93-a204-254e1b43c761 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:09.529528 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-725101ff-e568-4e93-a204-254e1b43c761 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:09.529954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-725101ff-e568-4e93-a204-254e1b43c761 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:09.665935 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-725101ff-e568-4e93-a204-254e1b43c761 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:09.674477 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-725101ff-e568-4e93-a204-254e1b43c761 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.159517 Jun 16 18:19:09.675065 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 549/1096] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:09 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:19:10.692470 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-24b90830-71b2-408e-b02c-426be2b0b2d1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:10.693120 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-24b90830-71b2-408e-b02c-426be2b0b2d1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:10.701148 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24b90830-71b2-408e-b02c-426be2b0b2d1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:10.701591 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24b90830-71b2-408e-b02c-426be2b0b2d1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:10.702448 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24b90830-71b2-408e-b02c-426be2b0b2d1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:10.702880 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-24b90830-71b2-408e-b02c-426be2b0b2d1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:10.841767 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-24b90830-71b2-408e-b02c-426be2b0b2d1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:10.849577 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-24b90830-71b2-408e-b02c-426be2b0b2d1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.160975 Jun 16 18:19:10.850153 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 548/1097] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:10 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:11.866494 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-744cc18f-2057-4390-99d4-2d07e852532a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:11.867088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-744cc18f-2057-4390-99d4-2d07e852532a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:11.873571 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-744cc18f-2057-4390-99d4-2d07e852532a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:11.874022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-744cc18f-2057-4390-99d4-2d07e852532a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:11.874780 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-744cc18f-2057-4390-99d4-2d07e852532a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:11.875266 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-744cc18f-2057-4390-99d4-2d07e852532a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:12.008031 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-744cc18f-2057-4390-99d4-2d07e852532a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:12.016613 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-744cc18f-2057-4390-99d4-2d07e852532a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.154023 Jun 16 18:19:12.017383 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 550/1098] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:11 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:13.034415 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4de34bdd-8fae-44d8-a352-2f7c86434bcc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:13.035007 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4de34bdd-8fae-44d8-a352-2f7c86434bcc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:13.041860 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4de34bdd-8fae-44d8-a352-2f7c86434bcc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:13.042329 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4de34bdd-8fae-44d8-a352-2f7c86434bcc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:13.043120 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4de34bdd-8fae-44d8-a352-2f7c86434bcc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:13.044261 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4de34bdd-8fae-44d8-a352-2f7c86434bcc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:13.179399 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4de34bdd-8fae-44d8-a352-2f7c86434bcc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:13.187269 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4de34bdd-8fae-44d8-a352-2f7c86434bcc tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.156680 Jun 16 18:19:13.187804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 549/1099] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:13 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:14.203745 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7e05247a-fa69-4f18-acd8-ddb43770585d tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:14.204379 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7e05247a-fa69-4f18-acd8-ddb43770585d tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:14.210879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7e05247a-fa69-4f18-acd8-ddb43770585d tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:14.211322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7e05247a-fa69-4f18-acd8-ddb43770585d tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:14.212115 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7e05247a-fa69-4f18-acd8-ddb43770585d tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:14.212542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7e05247a-fa69-4f18-acd8-ddb43770585d tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:14.345189 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7e05247a-fa69-4f18-acd8-ddb43770585d tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:14.352771 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7e05247a-fa69-4f18-acd8-ddb43770585d tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.153453 Jun 16 18:19:14.353348 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 551/1100] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:14 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:15.370344 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-02c8beaa-feaf-4866-a778-4e4eddc526ef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:15.370942 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-02c8beaa-feaf-4866-a778-4e4eddc526ef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:15.378424 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-02c8beaa-feaf-4866-a778-4e4eddc526ef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:15.378871 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-02c8beaa-feaf-4866-a778-4e4eddc526ef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:15.379707 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-02c8beaa-feaf-4866-a778-4e4eddc526ef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:15.380144 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-02c8beaa-feaf-4866-a778-4e4eddc526ef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:15.519130 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-02c8beaa-feaf-4866-a778-4e4eddc526ef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:15.527078 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-02c8beaa-feaf-4866-a778-4e4eddc526ef tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.160744 Jun 16 18:19:15.528043 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 550/1101] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:15 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:15.879659 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-bd93a7bb-b2bb-4f96-bce7-1c95b67f493a req-b2987836-73b6-4faa-af6d-122669544131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b74cf17-0efd-4f08-8a68-deb3ea646499", "name": "network-vif-plugged", "status": "completed", "tag": "1eca41c3-6e5c-433a-8853-14c1c2c804e3"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:19:15.888415 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-bd93a7bb-b2bb-4f96-bce7-1c95b67f493a req-b2987836-73b6-4faa-af6d-122669544131 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:15.888872 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-bd93a7bb-b2bb-4f96-bce7-1c95b67f493a req-b2987836-73b6-4faa-af6d-122669544131 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:15.899984 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-bd93a7bb-b2bb-4f96-bce7-1c95b67f493a req-b2987836-73b6-4faa-af6d-122669544131 service nova] Creating event network-vif-plugged:1eca41c3-6e5c-433a-8853-14c1c2c804e3 for instance 6b74cf17-0efd-4f08-8a68-deb3ea646499 on hv-cinder-83754 Jun 16 18:19:15.905496 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-bd93a7bb-b2bb-4f96-bce7-1c95b67f493a req-b2987836-73b6-4faa-af6d-122669544131 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164613 Jun 16 18:19:15.906093 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 552/1102] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:19:16.544279 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-c0ce61f3-c1b1-42c5-ab4c-b362f247bdab tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:16.544970 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-c0ce61f3-c1b1-42c5-ab4c-b362f247bdab tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:16.551934 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c0ce61f3-c1b1-42c5-ab4c-b362f247bdab tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:16.552383 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c0ce61f3-c1b1-42c5-ab4c-b362f247bdab tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:16.553156 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c0ce61f3-c1b1-42c5-ab4c-b362f247bdab tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:16.553592 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-c0ce61f3-c1b1-42c5-ab4c-b362f247bdab tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:16.687912 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-c0ce61f3-c1b1-42c5-ab4c-b362f247bdab tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:16.695328 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-c0ce61f3-c1b1-42c5-ab4c-b362f247bdab tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.154934 Jun 16 18:19:16.695920 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 551/1103] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:16 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:17.714746 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f4e73eeb-6c97-40b2-8f81-97eb46745a65 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:17.715497 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f4e73eeb-6c97-40b2-8f81-97eb46745a65 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:17.722992 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f4e73eeb-6c97-40b2-8f81-97eb46745a65 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:17.723462 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f4e73eeb-6c97-40b2-8f81-97eb46745a65 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:17.724254 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f4e73eeb-6c97-40b2-8f81-97eb46745a65 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:17.724683 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f4e73eeb-6c97-40b2-8f81-97eb46745a65 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:17.863019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-f4e73eeb-6c97-40b2-8f81-97eb46745a65 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:17.871758 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f4e73eeb-6c97-40b2-8f81-97eb46745a65 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1318 microversion: 2.1 time: 0.162115 Jun 16 18:19:17.872533 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 553/1104] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:17 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:18.888905 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-56cef7fe-7441-427b-8ef9-23a4d5322763 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:19:18.889635 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-56cef7fe-7441-427b-8ef9-23a4d5322763 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:18.896604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-56cef7fe-7441-427b-8ef9-23a4d5322763 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:18.897053 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-56cef7fe-7441-427b-8ef9-23a4d5322763 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:18.897838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-56cef7fe-7441-427b-8ef9-23a4d5322763 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:18.898311 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-56cef7fe-7441-427b-8ef9-23a4d5322763 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:19.029411 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-56cef7fe-7441-427b-8ef9-23a4d5322763 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:19:19.037716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-56cef7fe-7441-427b-8ef9-23a4d5322763 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1507 microversion: 2.1 time: 0.152722 Jun 16 18:19:19.038284 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 552/1105] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:19:18 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:19:45.387584 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8218de70-c7f7-44d2-801f-78779bd3a808 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9bd2d46-1a90-41ed-818b-9e1ca2825451", "device": "/dev/sdb"}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:19:45.391035 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8218de70-c7f7-44d2-801f-78779bd3a808 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:19:45.391587 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:19:45.392241 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=64 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:19:45.397022 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8218de70-c7f7-44d2-801f-78779bd3a808 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:45.397466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8218de70-c7f7-44d2-801f-78779bd3a808 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:45.398234 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8218de70-c7f7-44d2-801f-78779bd3a808 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:19:45.398665 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8218de70-c7f7-44d2-801f-78779bd3a808 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:19:46.554792 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8218de70-c7f7-44d2-801f-78779bd3a808 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "POST /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.171230 Jun 16 18:19:46.555594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 554/1106] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:19:45 2022] POST /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499/os-volume_attachments => generated 194 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:20:04.883665 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:20:04.884247 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Thu Jun 16 18:20:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:20:22.940911 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=26 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:22.941649 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=62 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:22.945714 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4b2375ab-0ed8-42d2-ba57-01fb8dd6e50e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:22.946208 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4b2375ab-0ed8-42d2-ba57-01fb8dd6e50e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:22.952232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4b2375ab-0ed8-42d2-ba57-01fb8dd6e50e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:22.952660 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4b2375ab-0ed8-42d2-ba57-01fb8dd6e50e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:22.954438 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4b2375ab-0ed8-42d2-ba57-01fb8dd6e50e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:22.954870 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4b2375ab-0ed8-42d2-ba57-01fb8dd6e50e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:23.037233 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-4b2375ab-0ed8-42d2-ba57-01fb8dd6e50e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lazy-loading 'services' on Instance uuid 6b74cf17-0efd-4f08-8a68-deb3ea646499 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:20:23.292889 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4b2375ab-0ed8-42d2-ba57-01fb8dd6e50e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499/os-volume_attachments/b9bd2d46-1a90-41ed-818b-9e1ca2825451" status: 202 len: 0 microversion: 2.1 time: 0.353418 Jun 16 18:20:23.293484 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 553/1107] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jun 16 18:20:22 2022] DELETE /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499/os-volume_attachments/b9bd2d46-1a90-41ed-818b-9e1ca2825451 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:20:25.492132 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:25.496596 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:25.497414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-5e699344-153e-4627-ae03-bdc0cb709c3f tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:25.498149 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5e699344-153e-4627-ae03-bdc0cb709c3f tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:25.505563 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5e699344-153e-4627-ae03-bdc0cb709c3f tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:25.505942 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5e699344-153e-4627-ae03-bdc0cb709c3f tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:25.506743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5e699344-153e-4627-ae03-bdc0cb709c3f tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:25.507169 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-5e699344-153e-4627-ae03-bdc0cb709c3f tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:25.533098 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-5e699344-153e-4627-ae03-bdc0cb709c3f tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Going to try to terminate instance {{(pid=118161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:20:25.893629 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-5e699344-153e-4627-ae03-bdc0cb709c3f tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 204 len: 0 microversion: 2.1 time: 0.402653 Jun 16 18:20:25.894334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 555/1108] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:20:25 2022] DELETE /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:20:25.903994 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-34970fd4-be13-40b8-8f13-014fcdbbc5df tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:25.904694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-34970fd4-be13-40b8-8f13-014fcdbbc5df tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:25.912077 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-34970fd4-be13-40b8-8f13-014fcdbbc5df tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:25.912549 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-34970fd4-be13-40b8-8f13-014fcdbbc5df tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:25.913326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-34970fd4-be13-40b8-8f13-014fcdbbc5df tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:25.913763 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-34970fd4-be13-40b8-8f13-014fcdbbc5df tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:26.049030 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-34970fd4-be13-40b8-8f13-014fcdbbc5df tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:26.056602 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-34970fd4-be13-40b8-8f13-014fcdbbc5df tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1513 microversion: 2.1 time: 0.157568 Jun 16 18:20:26.057162 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 554/1109] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:25 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:27.074668 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d981fcfe-87d1-4242-9ca5-92d02e3e384e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:27.075382 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d981fcfe-87d1-4242-9ca5-92d02e3e384e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:27.082415 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d981fcfe-87d1-4242-9ca5-92d02e3e384e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:27.082856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d981fcfe-87d1-4242-9ca5-92d02e3e384e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:27.083657 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d981fcfe-87d1-4242-9ca5-92d02e3e384e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:27.084085 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d981fcfe-87d1-4242-9ca5-92d02e3e384e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:27.232306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d981fcfe-87d1-4242-9ca5-92d02e3e384e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:27.242399 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d981fcfe-87d1-4242-9ca5-92d02e3e384e tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1513 microversion: 2.1 time: 0.171984 Jun 16 18:20:27.243332 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 556/1110] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:27 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:28.261381 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a0338b21-5788-4082-811e-a05c615b3335 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:28.261997 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a0338b21-5788-4082-811e-a05c615b3335 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:28.268811 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a0338b21-5788-4082-811e-a05c615b3335 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:28.269264 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a0338b21-5788-4082-811e-a05c615b3335 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:28.270047 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a0338b21-5788-4082-811e-a05c615b3335 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:28.270505 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a0338b21-5788-4082-811e-a05c615b3335 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:28.425459 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a0338b21-5788-4082-811e-a05c615b3335 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:28.433371 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a0338b21-5788-4082-811e-a05c615b3335 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1513 microversion: 2.1 time: 0.175879 Jun 16 18:20:28.433941 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 555/1111] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:28 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:28.542950 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-156295d2-52d7-4f3d-912d-ff11c56fd54b req-72194289-10b8-4380-8efe-b4b2d1f2137c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b74cf17-0efd-4f08-8a68-deb3ea646499", "name": "network-vif-deleted", "tag": "1eca41c3-6e5c-433a-8853-14c1c2c804e3"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:20:28.552711 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-156295d2-52d7-4f3d-912d-ff11c56fd54b req-72194289-10b8-4380-8efe-b4b2d1f2137c service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:28.553128 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-156295d2-52d7-4f3d-912d-ff11c56fd54b req-72194289-10b8-4380-8efe-b4b2d1f2137c service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:28.569147 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-156295d2-52d7-4f3d-912d-ff11c56fd54b req-72194289-10b8-4380-8efe-b4b2d1f2137c service nova] Creating event network-vif-deleted:1eca41c3-6e5c-433a-8853-14c1c2c804e3 for instance 6b74cf17-0efd-4f08-8a68-deb3ea646499 on hv-cinder-83754 Jun 16 18:20:28.576930 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-156295d2-52d7-4f3d-912d-ff11c56fd54b req-72194289-10b8-4380-8efe-b4b2d1f2137c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037629 Jun 16 18:20:28.578078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 557/1112] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:20:29.450336 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0bdd30bf-1fbd-43d3-9017-7f83cb9291a4 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:29.450960 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0bdd30bf-1fbd-43d3-9017-7f83cb9291a4 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:29.457904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0bdd30bf-1fbd-43d3-9017-7f83cb9291a4 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:29.458351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0bdd30bf-1fbd-43d3-9017-7f83cb9291a4 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:29.459111 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0bdd30bf-1fbd-43d3-9017-7f83cb9291a4 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:29.459659 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0bdd30bf-1fbd-43d3-9017-7f83cb9291a4 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:29.493309 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0bdd30bf-1fbd-43d3-9017-7f83cb9291a4 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:29.493670 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0bdd30bf-1fbd-43d3-9017-7f83cb9291a4 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:29.494119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-0bdd30bf-1fbd-43d3-9017-7f83cb9291a4 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lazy-loading 'fault' on Instance uuid 6b74cf17-0efd-4f08-8a68-deb3ea646499 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:20:29.535057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0bdd30bf-1fbd-43d3-9017-7f83cb9291a4 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:29.542662 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0bdd30bf-1fbd-43d3-9017-7f83cb9291a4 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 200 len: 1308 microversion: 2.1 time: 0.096187 Jun 16 18:20:29.543264 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 556/1113] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:29 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:30.563169 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f29be06b-a19f-4f38-a1ca-2cf258feac88 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:30.563809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f29be06b-a19f-4f38-a1ca-2cf258feac88 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 6b74cf17-0efd-4f08-8a68-deb3ea646499] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:30.570163 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f29be06b-a19f-4f38-a1ca-2cf258feac88 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:30.570602 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f29be06b-a19f-4f38-a1ca-2cf258feac88 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:30.571785 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f29be06b-a19f-4f38-a1ca-2cf258feac88 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:30.571913 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f29be06b-a19f-4f38-a1ca-2cf258feac88 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:30.587030 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-f29be06b-a19f-4f38-a1ca-2cf258feac88 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] HTTP exception thrown: Instance 6b74cf17-0efd-4f08-8a68-deb3ea646499 could not be found. Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f29be06b-a19f-4f38-a1ca-2cf258feac88 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Request method failure captured: Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 HTTP/1.1 Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3QLRNbYB-DQ60H159ZmsezJvQ65Pnw6YCNx2WBEf5jaRJzy4cSQFejK6ndt9l-Mn-qwccTz9PrasnGkJDgniKbmEwz8cUdmB1VKJzc2xFCz4MNK2RszfY570Kyl2ijBTsfUDNWBMxIq6u92_fTPILcNJa9OxDCMDpZ0gXvAMoIL-3I Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: c3974a2bdfca4093986a7ca6cd926d58 Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1707455906 Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:20:30.588684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:20:30.590505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c3974a2bdfca4093986a7ca6cd926d58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c3974a2bdfca4093986a7ca6cd926d58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c3974a2bdfca4093986a7ca6cd926d58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c3974a2bdfca4093986a7ca6cd926d58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:20:30.590505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-VolumesSnapshotTestJSON-1707455906 Jun 16 18:20:30.590505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: c3974a2bdfca4093986a7ca6cd926d58 Jun 16 18:20:30.590505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1707455906 Jun 16 18:20:30.590505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-VolumesSnapshotTestJSON-1707455906-project Jun 16 18:20:30.590505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:20:30.590505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:20:30.590505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: 4fca3484e66343849b9efcd87c17b1ac Jun 16 18:20:30.590505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-VolumesSnapshotTestJSON-1707455906-project Jun 16 18:20:30.590505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:20:30.590505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 6b74cf17-0efd-4f08-8a68-deb3ea646499 could not be found. Jun 16 18:20:30.590505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '6b74cf17-0efd-4f08-8a68-deb3ea646499'} Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b74cf17-0efd-4f08-8a68-deb3ea646499 could not be found. Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:20:30.591709 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b74cf17-0efd-4f08-8a68-deb3ea646499 could not be found. Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b74cf17-0efd-4f08-8a68-deb3ea646499 could not be found. Jun 16 18:20:30.593392 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:20:30.595940 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f29be06b-a19f-4f38-a1ca-2cf258feac88 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Returning 404 to user: Instance 6b74cf17-0efd-4f08-8a68-deb3ea646499 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:20:30.595940 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f29be06b-a19f-4f38-a1ca-2cf258feac88 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499" status: 404 len: 111 microversion: 2.1 time: 0.031796 Jun 16 18:20:30.595940 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 558/1114] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:30 2022] GET /compute/v2.1/servers/6b74cf17-0efd-4f08-8a68-deb3ea646499 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:20:36.352624 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-fbfe742f-fa47-431b-8268-9f06e2d3f580 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:36.353231 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-fbfe742f-fa47-431b-8268-9f06e2d3f580 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:36.359781 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fbfe742f-fa47-431b-8268-9f06e2d3f580 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:36.360240 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fbfe742f-fa47-431b-8268-9f06e2d3f580 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:36.361562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fbfe742f-fa47-431b-8268-9f06e2d3f580 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:36.361999 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fbfe742f-fa47-431b-8268-9f06e2d3f580 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:36.393444 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-fbfe742f-fa47-431b-8268-9f06e2d3f580 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Going to try to terminate instance {{(pid=118162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:20:36.687461 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-fbfe742f-fa47-431b-8268-9f06e2d3f580 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 204 len: 0 microversion: 2.1 time: 0.338524 Jun 16 18:20:36.688048 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 557/1115] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:20:36 2022] DELETE /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:20:36.696400 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-80648d70-3f2b-4b80-8c4f-81070993e9b9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:36.697055 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-80648d70-3f2b-4b80-8c4f-81070993e9b9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:36.703661 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-80648d70-3f2b-4b80-8c4f-81070993e9b9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:36.708322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-80648d70-3f2b-4b80-8c4f-81070993e9b9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:36.708322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-80648d70-3f2b-4b80-8c4f-81070993e9b9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:36.708322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-80648d70-3f2b-4b80-8c4f-81070993e9b9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:36.839542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-80648d70-3f2b-4b80-8c4f-81070993e9b9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:36.847964 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-80648d70-3f2b-4b80-8c4f-81070993e9b9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1578 microversion: 2.1 time: 0.155501 Jun 16 18:20:36.848519 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 559/1116] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:36 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:37.866684 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-df2f94e5-7446-4c48-966e-99c46b6d4473 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:37.867330 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-df2f94e5-7446-4c48-966e-99c46b6d4473 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:37.873939 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-df2f94e5-7446-4c48-966e-99c46b6d4473 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:37.874394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-df2f94e5-7446-4c48-966e-99c46b6d4473 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:37.875160 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-df2f94e5-7446-4c48-966e-99c46b6d4473 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:37.875638 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-df2f94e5-7446-4c48-966e-99c46b6d4473 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:38.036020 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-df2f94e5-7446-4c48-966e-99c46b6d4473 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:38.043765 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-df2f94e5-7446-4c48-966e-99c46b6d4473 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1578 microversion: 2.1 time: 0.181497 Jun 16 18:20:38.048615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 558/1117] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:37 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:20:39.062059 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ce64be5a-684d-4e38-89f8-fb8f788be641 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:39.062641 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ce64be5a-684d-4e38-89f8-fb8f788be641 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:39.069756 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce64be5a-684d-4e38-89f8-fb8f788be641 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:39.070206 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce64be5a-684d-4e38-89f8-fb8f788be641 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:39.070987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce64be5a-684d-4e38-89f8-fb8f788be641 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:39.071454 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ce64be5a-684d-4e38-89f8-fb8f788be641 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:39.215739 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ce64be5a-684d-4e38-89f8-fb8f788be641 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:39.224352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ce64be5a-684d-4e38-89f8-fb8f788be641 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1578 microversion: 2.1 time: 0.166330 Jun 16 18:20:39.225014 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 560/1118] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:39 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:40.243622 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2760db96-d4ed-4236-9e51-d607925ab2d6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:40.244476 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2760db96-d4ed-4236-9e51-d607925ab2d6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:40.251615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2760db96-d4ed-4236-9e51-d607925ab2d6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:40.252082 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2760db96-d4ed-4236-9e51-d607925ab2d6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:40.252902 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2760db96-d4ed-4236-9e51-d607925ab2d6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:40.253343 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2760db96-d4ed-4236-9e51-d607925ab2d6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:40.402751 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2760db96-d4ed-4236-9e51-d607925ab2d6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:40.413475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2760db96-d4ed-4236-9e51-d607925ab2d6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1578 microversion: 2.1 time: 0.173988 Jun 16 18:20:40.414060 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 559/1119] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:40 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:41.434680 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d922ae93-372c-401b-ac60-2fddd34da8f5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:41.435705 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d922ae93-372c-401b-ac60-2fddd34da8f5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:41.446343 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d922ae93-372c-401b-ac60-2fddd34da8f5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:41.447090 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d922ae93-372c-401b-ac60-2fddd34da8f5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:41.448401 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d922ae93-372c-401b-ac60-2fddd34da8f5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:41.449086 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d922ae93-372c-401b-ac60-2fddd34da8f5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:41.540340 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d922ae93-372c-401b-ac60-2fddd34da8f5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:41.552381 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d922ae93-372c-401b-ac60-2fddd34da8f5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1510 microversion: 2.1 time: 0.123902 Jun 16 18:20:41.553492 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 561/1120] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:41 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1510 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:41.585800 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-53412e79-44b0-41c7-966e-1601a4d8f606 req-7c91a670-e71c-424b-89c0-9ba09c09268d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae1e37c8-4486-40de-8fed-db9178d0e6f8", "name": "network-vif-deleted", "tag": "0bee7f88-0741-40db-a53b-d1e8f2fd6ab0"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:20:41.595068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-53412e79-44b0-41c7-966e-1601a4d8f606 req-7c91a670-e71c-424b-89c0-9ba09c09268d service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:41.595649 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-53412e79-44b0-41c7-966e-1601a4d8f606 req-7c91a670-e71c-424b-89c0-9ba09c09268d service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:41.609009 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-53412e79-44b0-41c7-966e-1601a4d8f606 req-7c91a670-e71c-424b-89c0-9ba09c09268d service nova] Creating event network-vif-deleted:0bee7f88-0741-40db-a53b-d1e8f2fd6ab0 for instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 on hv-cinder-83754 Jun 16 18:20:41.615940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-53412e79-44b0-41c7-966e-1601a4d8f606 req-7c91a670-e71c-424b-89c0-9ba09c09268d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033890 Jun 16 18:20:41.616856 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 560/1121] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:20:42.578803 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-521632f8-8301-4e32-ad5d-4e951ff92fb5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:42.578803 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-521632f8-8301-4e32-ad5d-4e951ff92fb5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:42.588842 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-521632f8-8301-4e32-ad5d-4e951ff92fb5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:42.589200 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-521632f8-8301-4e32-ad5d-4e951ff92fb5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:42.589975 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-521632f8-8301-4e32-ad5d-4e951ff92fb5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:42.590396 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-521632f8-8301-4e32-ad5d-4e951ff92fb5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:42.670986 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-521632f8-8301-4e32-ad5d-4e951ff92fb5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:42.681227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-521632f8-8301-4e32-ad5d-4e951ff92fb5 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 200 len: 1224 microversion: 2.1 time: 0.107290 Jun 16 18:20:42.682097 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 562/1122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:42 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:43.268394 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1597976720", "imageRef": "9146668b-81e6-47d5-a1e5-3dac8d19089f", "flavorRef": "452", "networks": [{"uuid": "fed4a843-c424-41d3-92ff-8a52b736d0b6"}]}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:20:43.328675 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.network.neutron [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] validate_networks() for [('fed4a843-c424-41d3-92ff-8a52b736d0b6', None, None, None, None, None)] {{(pid=118162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:20:43.699879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8e02ec6c-8e7e-47b4-bd38-9fd859870282 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:43.700527 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8e02ec6c-8e7e-47b4-bd38-9fd859870282 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:43.708625 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8e02ec6c-8e7e-47b4-bd38-9fd859870282 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:43.709239 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8e02ec6c-8e7e-47b4-bd38-9fd859870282 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:43.710045 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8e02ec6c-8e7e-47b4-bd38-9fd859870282 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:43.710475 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8e02ec6c-8e7e-47b4-bd38-9fd859870282 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:43.725319 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-8e02ec6c-8e7e-47b4-bd38-9fd859870282 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] HTTP exception thrown: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8e02ec6c-8e7e-47b4-bd38-9fd859870282 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Request method failure captured: Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 HTTP/1.1 Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3OBg-bnA_FUK4o7k_Ow1XSS_a3_up4kTPK_YsZRBCqtQyxw2rZiqPZ__iDqPLuraM8a6zBD5WZPJartqv-BMJ42rsHnNRSZY2G1YRYTTtg08O48A5zDArbhrboGUvF9bt3zFaumzgaGNuDh4TE28am-Hf0BRnkrcUht8FzQHai9qRI Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: bff5c01fd0ab4348b4704765f0195d50 Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-TestVolumeBootPattern-689768747 Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:20:43.726847 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:20:43.728377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:20:43.728377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-TestVolumeBootPattern-689768747 Jun 16 18:20:43.728377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: bff5c01fd0ab4348b4704765f0195d50 Jun 16 18:20:43.728377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-TestVolumeBootPattern-689768747 Jun 16 18:20:43.728377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-TestVolumeBootPattern-689768747-project Jun 16 18:20:43.728377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:20:43.728377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:20:43.728377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: f8cc86b384df4223a800838a3d386d3f Jun 16 18:20:43.728377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-TestVolumeBootPattern-689768747-project Jun 16 18:20:43.728377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:20:43.728377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:20:43.728377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': 'ae1e37c8-4486-40de-8fed-db9178d0e6f8'} Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:20:43.729287 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:20:43.730696 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:20:43.737484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8e02ec6c-8e7e-47b4-bd38-9fd859870282 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Returning 404 to user: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:20:43.737484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8e02ec6c-8e7e-47b4-bd38-9fd859870282 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 404 len: 111 microversion: 2.1 time: 0.032816 Jun 16 18:20:43.737484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 563/1123] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:43 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:20:43.830161 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Flavor limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:20:43.831529 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Image limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:20:43.832252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Flavor pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:20:43.832671 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Image pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:20:43.833476 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:20:43.843997 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-536532149", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-629434427", "security_groups": [{"name": "tempest-secgroup-smoke-1571274317"}], "block_device_mapping_v2": [{"uuid": "96740ad0-5b5b-48cf-adf2-d1313eb082ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "abadf347-d0dd-4369-8210-959891491bfa"}]}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:20:43.848137 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:43.848590 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:43.849395 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:43.849831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:43.874994 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Getting quotas for project c3974a2bdfca4093986a7ca6cd926d58. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:20:43.881129 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Getting quotas for user 4fca3484e66343849b9efcd87c17b1ac and project c3974a2bdfca4093986a7ca6cd926d58. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:20:43.894372 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Going to run 1 instances... {{(pid=118162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:20:43.896793 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9146668b-81e6-47d5-a1e5-3dac8d19089f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:20:43.973171 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] validate_networks() for [('abadf347-d0dd-4369-8210-959891491bfa', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:20:44.079820 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-afa412be-ab0b-400c-a0e5-8c6117e7eec1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815416 Jun 16 18:20:44.080949 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 561/1124] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:20:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:20:44.090891 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3875e795-a927-43d1-b0ac-43e8211df14f tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:44.091756 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3875e795-a927-43d1-b0ac-43e8211df14f tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:44.171780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3875e795-a927-43d1-b0ac-43e8211df14f tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:44.180580 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3875e795-a927-43d1-b0ac-43e8211df14f tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1219 microversion: 2.1 time: 0.093513 Jun 16 18:20:44.181308 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 562/1125] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:44 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:20:44.395138 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:20:44.395603 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:20:44.396111 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:20:44.396512 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:20:44.396947 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:20:44.406341 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:44.406860 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:44.407952 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:44.408405 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:44.426450 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Getting quotas for project bff5c01fd0ab4348b4704765f0195d50. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:20:44.430560 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Getting quotas for user f8cc86b384df4223a800838a3d386d3f and project bff5c01fd0ab4348b4704765f0195d50. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:20:44.505106 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:20:44.507250 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96740ad0-5b5b-48cf-adf2-d1313eb082ec',volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:20:45.096038 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-40cad155-696f-40c1-b066-3c694a6a80d0 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.255821 Jun 16 18:20:45.097648 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 564/1126] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:20:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:20:45.106747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-23395776-b3b6-4943-a796-751c79a76ec3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:45.107359 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-23395776-b3b6-4943-a796-751c79a76ec3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:45.165979 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-23395776-b3b6-4943-a796-751c79a76ec3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:45.173684 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-23395776-b3b6-4943-a796-751c79a76ec3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1093 microversion: 2.1 time: 0.070774 Jun 16 18:20:45.174336 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 563/1127] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:45 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:45.200957 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-20ecee3c-0622-4470-a114-17ad1da75e71 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:45.201574 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-20ecee3c-0622-4470-a114-17ad1da75e71 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:45.209734 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-20ecee3c-0622-4470-a114-17ad1da75e71 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:45.210291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-20ecee3c-0622-4470-a114-17ad1da75e71 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:45.210948 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-20ecee3c-0622-4470-a114-17ad1da75e71 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:45.211471 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-20ecee3c-0622-4470-a114-17ad1da75e71 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:45.277416 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-20ecee3c-0622-4470-a114-17ad1da75e71 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:45.284702 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-20ecee3c-0622-4470-a114-17ad1da75e71 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1223 microversion: 2.1 time: 0.087596 Jun 16 18:20:45.285284 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 565/1128] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:45 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:46.192150 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-10daa82f-ee80-49f8-8c83-b7ccb828d239 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:46.192811 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-10daa82f-ee80-49f8-8c83-b7ccb828d239 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:46.200998 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-10daa82f-ee80-49f8-8c83-b7ccb828d239 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:46.201440 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-10daa82f-ee80-49f8-8c83-b7ccb828d239 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:46.202246 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-10daa82f-ee80-49f8-8c83-b7ccb828d239 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:46.202683 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-10daa82f-ee80-49f8-8c83-b7ccb828d239 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:46.271241 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-10daa82f-ee80-49f8-8c83-b7ccb828d239 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:46.278873 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-10daa82f-ee80-49f8-8c83-b7ccb828d239 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1143 microversion: 2.1 time: 0.091563 Jun 16 18:20:46.279455 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 564/1129] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:46 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1143 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:46.302427 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2c4b1b23-a78b-4db1-9fd7-93fddd8543f1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:46.303029 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2c4b1b23-a78b-4db1-9fd7-93fddd8543f1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:46.309942 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2c4b1b23-a78b-4db1-9fd7-93fddd8543f1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:46.310473 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2c4b1b23-a78b-4db1-9fd7-93fddd8543f1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:46.311257 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2c4b1b23-a78b-4db1-9fd7-93fddd8543f1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:46.311724 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2c4b1b23-a78b-4db1-9fd7-93fddd8543f1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:46.383509 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2c4b1b23-a78b-4db1-9fd7-93fddd8543f1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:46.391118 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2c4b1b23-a78b-4db1-9fd7-93fddd8543f1 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1271 microversion: 2.1 time: 0.093367 Jun 16 18:20:46.391792 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 566/1130] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:46 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:47.296075 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-318e5268-b58d-410c-804c-e5dc1eadc7a6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:47.296753 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-318e5268-b58d-410c-804c-e5dc1eadc7a6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:47.303908 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-318e5268-b58d-410c-804c-e5dc1eadc7a6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:47.304335 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-318e5268-b58d-410c-804c-e5dc1eadc7a6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:47.305127 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-318e5268-b58d-410c-804c-e5dc1eadc7a6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:47.305562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-318e5268-b58d-410c-804c-e5dc1eadc7a6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:47.374130 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-318e5268-b58d-410c-804c-e5dc1eadc7a6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:47.382486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-318e5268-b58d-410c-804c-e5dc1eadc7a6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1191 microversion: 2.1 time: 0.090256 Jun 16 18:20:47.387969 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 565/1131] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:47 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:47.410386 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-23d59614-1cb3-4db8-82f0-a878de67eef9 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:47.411249 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-23d59614-1cb3-4db8-82f0-a878de67eef9 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:47.429423 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-23d59614-1cb3-4db8-82f0-a878de67eef9 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:47.430062 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-23d59614-1cb3-4db8-82f0-a878de67eef9 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:47.431285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-23d59614-1cb3-4db8-82f0-a878de67eef9 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:47.431822 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-23d59614-1cb3-4db8-82f0-a878de67eef9 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:47.501424 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-23d59614-1cb3-4db8-82f0-a878de67eef9 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:47.511686 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-23d59614-1cb3-4db8-82f0-a878de67eef9 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1277 microversion: 2.1 time: 0.106526 Jun 16 18:20:47.512278 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 567/1132] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:47 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:48.401222 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0c9134ac-e1be-494d-8e46-970be765c82a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:48.402496 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0c9134ac-e1be-494d-8e46-970be765c82a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:48.416224 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0c9134ac-e1be-494d-8e46-970be765c82a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:48.417799 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0c9134ac-e1be-494d-8e46-970be765c82a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:48.419621 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0c9134ac-e1be-494d-8e46-970be765c82a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:48.420631 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0c9134ac-e1be-494d-8e46-970be765c82a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:48.523326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0c9134ac-e1be-494d-8e46-970be765c82a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:48.531801 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0c9134ac-e1be-494d-8e46-970be765c82a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1209 microversion: 2.1 time: 0.135343 Jun 16 18:20:48.532624 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 566/1133] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:48 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1209 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:48.535945 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-af4d5628-232d-483a-8fb9-ddf412bb76ac tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:48.536662 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-af4d5628-232d-483a-8fb9-ddf412bb76ac tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:48.543298 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-af4d5628-232d-483a-8fb9-ddf412bb76ac tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:48.544026 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-af4d5628-232d-483a-8fb9-ddf412bb76ac tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:48.544804 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-af4d5628-232d-483a-8fb9-ddf412bb76ac tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:48.545240 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-af4d5628-232d-483a-8fb9-ddf412bb76ac tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:48.811213 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-1e223a26-4ed6-47f0-aebb-a417b105adfa req-18080c69-50e8-4688-b020-c4c8784477b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d95db9-2ab3-46b5-b70e-346b739ea0de", "tag": "b63930da-5493-4109-96a2-372263025ac0"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:20:48.838470 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-1e223a26-4ed6-47f0-aebb-a417b105adfa req-18080c69-50e8-4688-b020-c4c8784477b4 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:48.838470 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-1e223a26-4ed6-47f0-aebb-a417b105adfa req-18080c69-50e8-4688-b020-c4c8784477b4 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:48.853215 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-1e223a26-4ed6-47f0-aebb-a417b105adfa req-18080c69-50e8-4688-b020-c4c8784477b4 service nova] Creating event network-changed:b63930da-5493-4109-96a2-372263025ac0 for instance 95d95db9-2ab3-46b5-b70e-346b739ea0de on hv-cinder-83754 Jun 16 18:20:48.860887 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-1e223a26-4ed6-47f0-aebb-a417b105adfa req-18080c69-50e8-4688-b020-c4c8784477b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059256 Jun 16 18:20:48.861501 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 567/1134] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:20:49.088495 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-af4d5628-232d-483a-8fb9-ddf412bb76ac tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:49.104386 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-af4d5628-232d-483a-8fb9-ddf412bb76ac tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1319 microversion: 2.1 time: 0.571579 Jun 16 18:20:49.105701 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 568/1135] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:48 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1319 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:49.552950 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6476e97c-f423-4c94-b857-c92a112de09f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:49.553885 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6476e97c-f423-4c94-b857-c92a112de09f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:49.572821 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6476e97c-f423-4c94-b857-c92a112de09f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:49.573279 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6476e97c-f423-4c94-b857-c92a112de09f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:49.574070 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6476e97c-f423-4c94-b857-c92a112de09f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:49.574537 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6476e97c-f423-4c94-b857-c92a112de09f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:49.797891 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6476e97c-f423-4c94-b857-c92a112de09f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:49.810224 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6476e97c-f423-4c94-b857-c92a112de09f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1277 microversion: 2.1 time: 0.263535 Jun 16 18:20:49.811835 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 568/1136] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:49 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1277 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:20:50.102468 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-e231821a-c68e-43cf-a6b2-a48148d77110 req-dbac0d02-732b-4318-9a4b-6cf6fc1cdcf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eaa76e3-7d8a-4702-bcca-4d870e086221", "tag": "b980ea2b-3e6e-4f83-93ba-c30098a1a716"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:20:50.115191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-e231821a-c68e-43cf-a6b2-a48148d77110 req-dbac0d02-732b-4318-9a4b-6cf6fc1cdcf7 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:50.115191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-e231821a-c68e-43cf-a6b2-a48148d77110 req-dbac0d02-732b-4318-9a4b-6cf6fc1cdcf7 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:50.125505 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-e231821a-c68e-43cf-a6b2-a48148d77110 req-dbac0d02-732b-4318-9a4b-6cf6fc1cdcf7 service nova] Creating event network-changed:b980ea2b-3e6e-4f83-93ba-c30098a1a716 for instance 8eaa76e3-7d8a-4702-bcca-4d870e086221 on hv-cinder-83754 Jun 16 18:20:50.131027 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1667a097-e8fb-48cd-a0fc-3377a8fbb4c6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:50.131958 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1667a097-e8fb-48cd-a0fc-3377a8fbb4c6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:50.133301 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-e231821a-c68e-43cf-a6b2-a48148d77110 req-dbac0d02-732b-4318-9a4b-6cf6fc1cdcf7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034482 Jun 16 18:20:50.134630 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 569/1137] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:20:50.139215 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1667a097-e8fb-48cd-a0fc-3377a8fbb4c6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:50.140457 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1667a097-e8fb-48cd-a0fc-3377a8fbb4c6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:50.141436 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1667a097-e8fb-48cd-a0fc-3377a8fbb4c6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:50.142474 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1667a097-e8fb-48cd-a0fc-3377a8fbb4c6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:50.307575 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1667a097-e8fb-48cd-a0fc-3377a8fbb4c6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:50.327701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1667a097-e8fb-48cd-a0fc-3377a8fbb4c6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1319 microversion: 2.1 time: 0.203141 Jun 16 18:20:50.328303 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 569/1138] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:50 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:50.829922 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-63cc0126-4450-4347-85c0-b35fe7fb20ef tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:50.830875 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-63cc0126-4450-4347-85c0-b35fe7fb20ef tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:50.837797 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-63cc0126-4450-4347-85c0-b35fe7fb20ef tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:50.838246 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-63cc0126-4450-4347-85c0-b35fe7fb20ef tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:50.839027 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-63cc0126-4450-4347-85c0-b35fe7fb20ef tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:50.839489 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-63cc0126-4450-4347-85c0-b35fe7fb20ef tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:50.982733 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-63cc0126-4450-4347-85c0-b35fe7fb20ef tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:50.991678 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-63cc0126-4450-4347-85c0-b35fe7fb20ef tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.166608 Jun 16 18:20:50.992259 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 570/1139] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:50 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:51.346356 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6c515f5f-c530-46b0-8f7d-c4fcd2e41112 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:51.347026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6c515f5f-c530-46b0-8f7d-c4fcd2e41112 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:51.353896 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6c515f5f-c530-46b0-8f7d-c4fcd2e41112 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:51.354342 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6c515f5f-c530-46b0-8f7d-c4fcd2e41112 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:51.355101 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6c515f5f-c530-46b0-8f7d-c4fcd2e41112 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:51.355561 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6c515f5f-c530-46b0-8f7d-c4fcd2e41112 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:51.504195 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6c515f5f-c530-46b0-8f7d-c4fcd2e41112 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:51.508622 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:51.516066 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6c515f5f-c530-46b0-8f7d-c4fcd2e41112 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1319 microversion: 2.1 time: 0.174444 Jun 16 18:20:51.518003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 570/1140] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:51 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:52.014986 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-86e84c30-c154-457f-94e3-2c179b01cc77 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:52.016594 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-86e84c30-c154-457f-94e3-2c179b01cc77 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:52.026881 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-86e84c30-c154-457f-94e3-2c179b01cc77 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:52.027767 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-86e84c30-c154-457f-94e3-2c179b01cc77 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:52.029081 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-86e84c30-c154-457f-94e3-2c179b01cc77 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:52.029976 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-86e84c30-c154-457f-94e3-2c179b01cc77 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:52.182722 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-86e84c30-c154-457f-94e3-2c179b01cc77 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:52.190592 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-86e84c30-c154-457f-94e3-2c179b01cc77 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.182950 Jun 16 18:20:52.191092 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 571/1141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:52 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:52.538586 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5e4027fb-4867-4430-afd4-4a669ab77029 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:52.539213 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5e4027fb-4867-4430-afd4-4a669ab77029 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:52.547021 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5e4027fb-4867-4430-afd4-4a669ab77029 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:52.549910 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5e4027fb-4867-4430-afd4-4a669ab77029 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:52.549910 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5e4027fb-4867-4430-afd4-4a669ab77029 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:52.550138 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5e4027fb-4867-4430-afd4-4a669ab77029 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:52.767829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5e4027fb-4867-4430-afd4-4a669ab77029 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:52.778361 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5e4027fb-4867-4430-afd4-4a669ab77029 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1319 microversion: 2.1 time: 0.243711 Jun 16 18:20:52.778940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 571/1142] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:52 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:20:53.208248 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d13883d3-8816-4ba3-a084-3dc99e936db8 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:53.208907 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d13883d3-8816-4ba3-a084-3dc99e936db8 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:53.215616 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d13883d3-8816-4ba3-a084-3dc99e936db8 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:53.216147 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d13883d3-8816-4ba3-a084-3dc99e936db8 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:53.216933 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d13883d3-8816-4ba3-a084-3dc99e936db8 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:53.217372 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d13883d3-8816-4ba3-a084-3dc99e936db8 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:53.352706 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d13883d3-8816-4ba3-a084-3dc99e936db8 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:53.360473 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d13883d3-8816-4ba3-a084-3dc99e936db8 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.156827 Jun 16 18:20:53.361057 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 572/1143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:53 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:53.796590 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3e6591d2-55c4-4b9c-ba45-f37d6e30da3c tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:53.797318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3e6591d2-55c4-4b9c-ba45-f37d6e30da3c tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:53.799555 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:53.804340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e6591d2-55c4-4b9c-ba45-f37d6e30da3c tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:53.804786 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e6591d2-55c4-4b9c-ba45-f37d6e30da3c tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:53.806050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e6591d2-55c4-4b9c-ba45-f37d6e30da3c tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:53.806478 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3e6591d2-55c4-4b9c-ba45-f37d6e30da3c tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:53.859485 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:53.954172 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3e6591d2-55c4-4b9c-ba45-f37d6e30da3c tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:53.962912 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3e6591d2-55c4-4b9c-ba45-f37d6e30da3c tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1319 microversion: 2.1 time: 0.170378 Jun 16 18:20:53.963530 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 572/1144] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:53 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:54.378694 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-7b737087-a6e1-4ee8-9b71-e98c1f088857 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:54.379345 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-7b737087-a6e1-4ee8-9b71-e98c1f088857 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:54.386715 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7b737087-a6e1-4ee8-9b71-e98c1f088857 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:54.387154 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7b737087-a6e1-4ee8-9b71-e98c1f088857 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:54.388222 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7b737087-a6e1-4ee8-9b71-e98c1f088857 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:54.388686 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-7b737087-a6e1-4ee8-9b71-e98c1f088857 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:54.395258 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:54.415250 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:54.437194 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=6 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:54.548038 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-7b737087-a6e1-4ee8-9b71-e98c1f088857 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:54.555623 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-7b737087-a6e1-4ee8-9b71-e98c1f088857 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.181917 Jun 16 18:20:54.556187 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 573/1145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:54 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:54.980804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d537ed61-112a-490e-86e1-68f99e4fb132 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:54.981531 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d537ed61-112a-490e-86e1-68f99e4fb132 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:54.989905 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d537ed61-112a-490e-86e1-68f99e4fb132 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:54.990369 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d537ed61-112a-490e-86e1-68f99e4fb132 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:54.991142 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d537ed61-112a-490e-86e1-68f99e4fb132 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:54.991610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d537ed61-112a-490e-86e1-68f99e4fb132 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:55.137861 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d537ed61-112a-490e-86e1-68f99e4fb132 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:55.150561 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d537ed61-112a-490e-86e1-68f99e4fb132 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1319 microversion: 2.1 time: 0.173794 Jun 16 18:20:55.151133 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 573/1146] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:54 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:20:55.574532 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1e3202c9-113c-4044-9a9f-b837b1e106f3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:55.575512 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1e3202c9-113c-4044-9a9f-b837b1e106f3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:55.578391 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:55.587088 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1e3202c9-113c-4044-9a9f-b837b1e106f3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:55.587803 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1e3202c9-113c-4044-9a9f-b837b1e106f3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:55.589051 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1e3202c9-113c-4044-9a9f-b837b1e106f3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:55.589586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1e3202c9-113c-4044-9a9f-b837b1e106f3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:55.755819 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1e3202c9-113c-4044-9a9f-b837b1e106f3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:55.766681 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1e3202c9-113c-4044-9a9f-b837b1e106f3 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.196865 Jun 16 18:20:55.767527 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 574/1147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:55 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:56.168654 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d22a2ecb-0e69-4b80-961c-bb2de9f79ed6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:56.169552 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d22a2ecb-0e69-4b80-961c-bb2de9f79ed6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:56.171159 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=10 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:20:56.178222 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d22a2ecb-0e69-4b80-961c-bb2de9f79ed6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:56.178760 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d22a2ecb-0e69-4b80-961c-bb2de9f79ed6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:56.179469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d22a2ecb-0e69-4b80-961c-bb2de9f79ed6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:56.179911 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d22a2ecb-0e69-4b80-961c-bb2de9f79ed6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:56.284370 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-148d65cb-0d44-4555-9f02-02e63333f340 req-69ba915a-ca58-41f0-8bf7-a15c9c825b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d95db9-2ab3-46b5-b70e-346b739ea0de", "name": "network-vif-plugged", "status": "completed", "tag": "b63930da-5493-4109-96a2-372263025ac0"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:20:56.298887 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-148d65cb-0d44-4555-9f02-02e63333f340 req-69ba915a-ca58-41f0-8bf7-a15c9c825b12 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:56.299779 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-148d65cb-0d44-4555-9f02-02e63333f340 req-69ba915a-ca58-41f0-8bf7-a15c9c825b12 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:56.315300 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-148d65cb-0d44-4555-9f02-02e63333f340 req-69ba915a-ca58-41f0-8bf7-a15c9c825b12 service nova] Creating event network-vif-plugged:b63930da-5493-4109-96a2-372263025ac0 for instance 95d95db9-2ab3-46b5-b70e-346b739ea0de on hv-cinder-83754 Jun 16 18:20:56.320474 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-148d65cb-0d44-4555-9f02-02e63333f340 req-69ba915a-ca58-41f0-8bf7-a15c9c825b12 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043523 Jun 16 18:20:56.321064 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 575/1148] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:20:56.343164 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d22a2ecb-0e69-4b80-961c-bb2de9f79ed6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:56.351466 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d22a2ecb-0e69-4b80-961c-bb2de9f79ed6 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1319 microversion: 2.1 time: 0.186699 Jun 16 18:20:56.352086 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 574/1149] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:56 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:56.789508 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-aeac13c4-db56-4316-b62b-30279f1d5143 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:56.790314 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-aeac13c4-db56-4316-b62b-30279f1d5143 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:56.798810 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aeac13c4-db56-4316-b62b-30279f1d5143 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:56.799597 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aeac13c4-db56-4316-b62b-30279f1d5143 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:56.800422 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aeac13c4-db56-4316-b62b-30279f1d5143 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:56.800850 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-aeac13c4-db56-4316-b62b-30279f1d5143 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:56.964079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-aeac13c4-db56-4316-b62b-30279f1d5143 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:56.973126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-aeac13c4-db56-4316-b62b-30279f1d5143 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.189008 Jun 16 18:20:56.974115 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 576/1150] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:56 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:20:57.371539 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d49ba4a2-6dc3-4a94-a9f9-484ea43cce4a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:57.372354 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d49ba4a2-6dc3-4a94-a9f9-484ea43cce4a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:57.381369 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d49ba4a2-6dc3-4a94-a9f9-484ea43cce4a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:57.381851 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d49ba4a2-6dc3-4a94-a9f9-484ea43cce4a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:57.383909 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d49ba4a2-6dc3-4a94-a9f9-484ea43cce4a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:57.385385 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d49ba4a2-6dc3-4a94-a9f9-484ea43cce4a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:57.539936 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d49ba4a2-6dc3-4a94-a9f9-484ea43cce4a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:57.547669 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d49ba4a2-6dc3-4a94-a9f9-484ea43cce4a tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1319 microversion: 2.1 time: 0.181715 Jun 16 18:20:57.548277 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 575/1151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:57 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:57.996450 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d993724b-abd5-496a-9f2e-336776909f8a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:57.997231 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d993724b-abd5-496a-9f2e-336776909f8a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:58.005060 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d993724b-abd5-496a-9f2e-336776909f8a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:58.005545 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d993724b-abd5-496a-9f2e-336776909f8a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:58.006346 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d993724b-abd5-496a-9f2e-336776909f8a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:58.006772 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d993724b-abd5-496a-9f2e-336776909f8a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:58.145730 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d993724b-abd5-496a-9f2e-336776909f8a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:58.153489 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d993724b-abd5-496a-9f2e-336776909f8a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.161305 Jun 16 18:20:58.154057 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 577/1152] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:57 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:58.567533 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4a49c8eb-2d4d-4f36-8a1d-461217d00ba2 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:58.568099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4a49c8eb-2d4d-4f36-8a1d-461217d00ba2 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:58.574686 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4a49c8eb-2d4d-4f36-8a1d-461217d00ba2 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:58.575126 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4a49c8eb-2d4d-4f36-8a1d-461217d00ba2 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:58.575998 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4a49c8eb-2d4d-4f36-8a1d-461217d00ba2 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:58.576424 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4a49c8eb-2d4d-4f36-8a1d-461217d00ba2 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:58.717813 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-4a49c8eb-2d4d-4f36-8a1d-461217d00ba2 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:58.727326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4a49c8eb-2d4d-4f36-8a1d-461217d00ba2 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1319 microversion: 2.1 time: 0.164371 Jun 16 18:20:58.727964 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 576/1153] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:58 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:20:59.173997 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9de2d42c-488f-4253-b117-f808d1e583e6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:59.174856 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9de2d42c-488f-4253-b117-f808d1e583e6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:59.182498 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9de2d42c-488f-4253-b117-f808d1e583e6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:59.182970 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9de2d42c-488f-4253-b117-f808d1e583e6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:59.183722 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9de2d42c-488f-4253-b117-f808d1e583e6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:59.184148 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9de2d42c-488f-4253-b117-f808d1e583e6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:59.325850 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9de2d42c-488f-4253-b117-f808d1e583e6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:59.334484 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9de2d42c-488f-4253-b117-f808d1e583e6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.167527 Jun 16 18:20:59.335130 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 578/1154] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:59 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:59.745104 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-fe69bf0e-d6e1-47e4-a5cd-d2fb7885e380 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:20:59.745751 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-fe69bf0e-d6e1-47e4-a5cd-d2fb7885e380 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:59.753143 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fe69bf0e-d6e1-47e4-a5cd-d2fb7885e380 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:59.753637 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fe69bf0e-d6e1-47e4-a5cd-d2fb7885e380 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:59.754413 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fe69bf0e-d6e1-47e4-a5cd-d2fb7885e380 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:59.754847 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-fe69bf0e-d6e1-47e4-a5cd-d2fb7885e380 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:59.902360 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-fe69bf0e-d6e1-47e4-a5cd-d2fb7885e380 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:20:59.910655 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-fe69bf0e-d6e1-47e4-a5cd-d2fb7885e380 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1508 microversion: 2.1 time: 0.169578 Jun 16 18:20:59.911231 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 577/1155] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:20:59 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:20:59.927865 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-89a933e5-f38b-4b52-b70a-a579e2ea4553 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35f19efb-19e3-441f-99f7-eac790ada889", "device": "/dev/sdb"}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:20:59.928946 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-89a933e5-f38b-4b52-b70a-a579e2ea4553 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:20:59.940925 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-89a933e5-f38b-4b52-b70a-a579e2ea4553 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:59.941365 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-89a933e5-f38b-4b52-b70a-a579e2ea4553 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:20:59.942168 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-89a933e5-f38b-4b52-b70a-a579e2ea4553 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:20:59.942945 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-89a933e5-f38b-4b52-b70a-a579e2ea4553 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:00.352040 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-ec630ad1-d9d6-4ceb-a28b-41f333b804fa tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:00.352646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-ec630ad1-d9d6-4ceb-a28b-41f333b804fa tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:00.358925 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ec630ad1-d9d6-4ceb-a28b-41f333b804fa tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:00.359385 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ec630ad1-d9d6-4ceb-a28b-41f333b804fa tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:00.360835 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ec630ad1-d9d6-4ceb-a28b-41f333b804fa tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:00.361723 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-ec630ad1-d9d6-4ceb-a28b-41f333b804fa tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:00.511212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-ec630ad1-d9d6-4ceb-a28b-41f333b804fa tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:21:00.519593 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-ec630ad1-d9d6-4ceb-a28b-41f333b804fa tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.171571 Jun 16 18:21:00.520155 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 578/1156] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:00 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:21:00.989605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-89a933e5-f38b-4b52-b70a-a579e2ea4553 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "POST /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.065431 Jun 16 18:21:00.990212 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 579/1157] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:20:59 2022] POST /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de/os-volume_attachments => generated 194 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:21:01.538170 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2a4a7b23-aebc-4035-a20d-f346f9907820 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:01.539001 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2a4a7b23-aebc-4035-a20d-f346f9907820 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:01.545945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2a4a7b23-aebc-4035-a20d-f346f9907820 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:01.546402 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2a4a7b23-aebc-4035-a20d-f346f9907820 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:01.547964 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2a4a7b23-aebc-4035-a20d-f346f9907820 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:01.548486 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2a4a7b23-aebc-4035-a20d-f346f9907820 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:01.696781 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2a4a7b23-aebc-4035-a20d-f346f9907820 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:21:01.704604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2a4a7b23-aebc-4035-a20d-f346f9907820 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.170658 Jun 16 18:21:01.705155 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 579/1158] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:01 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:02.725465 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9d5fe2e4-a05f-49af-93dd-479ff0834167 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:02.725465 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9d5fe2e4-a05f-49af-93dd-479ff0834167 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:02.730548 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9d5fe2e4-a05f-49af-93dd-479ff0834167 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:02.730996 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9d5fe2e4-a05f-49af-93dd-479ff0834167 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:02.731812 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9d5fe2e4-a05f-49af-93dd-479ff0834167 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:02.732250 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9d5fe2e4-a05f-49af-93dd-479ff0834167 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:02.906932 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9d5fe2e4-a05f-49af-93dd-479ff0834167 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:21:02.914654 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9d5fe2e4-a05f-49af-93dd-479ff0834167 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.196794 Jun 16 18:21:02.915220 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 580/1159] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:02 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:03.932514 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a4908c55-337c-4b20-951e-5f4d9dd39d1f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:03.933385 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a4908c55-337c-4b20-951e-5f4d9dd39d1f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:03.940431 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a4908c55-337c-4b20-951e-5f4d9dd39d1f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:03.940881 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a4908c55-337c-4b20-951e-5f4d9dd39d1f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:03.941650 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a4908c55-337c-4b20-951e-5f4d9dd39d1f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:03.942083 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a4908c55-337c-4b20-951e-5f4d9dd39d1f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:04.079080 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a4908c55-337c-4b20-951e-5f4d9dd39d1f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:21:04.089242 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a4908c55-337c-4b20-951e-5f4d9dd39d1f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.160562 Jun 16 18:21:04.089815 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 580/1160] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:03 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:21:04.321004 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-9707d887-fbc8-4400-8b56-a480c7a3371a req-8fb2a367-15d7-4f04-b20f-a8dae8b8a534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eaa76e3-7d8a-4702-bcca-4d870e086221", "name": "network-vif-plugged", "status": "completed", "tag": "b980ea2b-3e6e-4f83-93ba-c30098a1a716"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:04.331143 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-9707d887-fbc8-4400-8b56-a480c7a3371a req-8fb2a367-15d7-4f04-b20f-a8dae8b8a534 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:04.331770 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-9707d887-fbc8-4400-8b56-a480c7a3371a req-8fb2a367-15d7-4f04-b20f-a8dae8b8a534 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:04.343226 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-9707d887-fbc8-4400-8b56-a480c7a3371a req-8fb2a367-15d7-4f04-b20f-a8dae8b8a534 service nova] Creating event network-vif-plugged:b980ea2b-3e6e-4f83-93ba-c30098a1a716 for instance 8eaa76e3-7d8a-4702-bcca-4d870e086221 on hv-cinder-83754 Jun 16 18:21:04.349452 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-9707d887-fbc8-4400-8b56-a480c7a3371a req-8fb2a367-15d7-4f04-b20f-a8dae8b8a534 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032359 Jun 16 18:21:04.350036 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 581/1161] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:05.109096 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-af796ed2-7f71-4f7d-814f-2443b4d150f6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:05.111000 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-af796ed2-7f71-4f7d-814f-2443b4d150f6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:05.118646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-af796ed2-7f71-4f7d-814f-2443b4d150f6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:05.119243 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-af796ed2-7f71-4f7d-814f-2443b4d150f6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:05.120475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-af796ed2-7f71-4f7d-814f-2443b4d150f6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:05.121146 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-af796ed2-7f71-4f7d-814f-2443b4d150f6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:05.279717 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-af796ed2-7f71-4f7d-814f-2443b4d150f6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:21:05.288166 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-af796ed2-7f71-4f7d-814f-2443b4d150f6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.184615 Jun 16 18:21:05.288891 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 581/1162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:05 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:06.308881 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ae5d6104-a418-45e9-a7b5-590dd4ee0eae tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:06.309763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ae5d6104-a418-45e9-a7b5-590dd4ee0eae tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:06.317133 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ae5d6104-a418-45e9-a7b5-590dd4ee0eae tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:06.318241 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ae5d6104-a418-45e9-a7b5-590dd4ee0eae tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:06.319065 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ae5d6104-a418-45e9-a7b5-590dd4ee0eae tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:06.319265 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ae5d6104-a418-45e9-a7b5-590dd4ee0eae tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:06.489958 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ae5d6104-a418-45e9-a7b5-590dd4ee0eae tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:21:06.499048 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ae5d6104-a418-45e9-a7b5-590dd4ee0eae tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1265 microversion: 2.1 time: 0.196878 Jun 16 18:21:06.504037 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 582/1163] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:06 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:07.517427 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0f57360d-2811-48ac-89a1-531d78347168 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:07.518058 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0f57360d-2811-48ac-89a1-531d78347168 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:07.524859 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0f57360d-2811-48ac-89a1-531d78347168 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:07.525313 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0f57360d-2811-48ac-89a1-531d78347168 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:07.526089 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0f57360d-2811-48ac-89a1-531d78347168 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:07.526525 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0f57360d-2811-48ac-89a1-531d78347168 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:07.668416 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0f57360d-2811-48ac-89a1-531d78347168 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:21:07.676687 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0f57360d-2811-48ac-89a1-531d78347168 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1452 microversion: 2.1 time: 0.163272 Jun 16 18:21:07.677262 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 582/1164] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:07 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:07.693462 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-fffe8ec7-42a6-4466-928c-b0e037f0ae8d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:07.694079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-fffe8ec7-42a6-4466-928c-b0e037f0ae8d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:07.701147 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fffe8ec7-42a6-4466-928c-b0e037f0ae8d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:07.701600 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fffe8ec7-42a6-4466-928c-b0e037f0ae8d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:07.702380 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fffe8ec7-42a6-4466-928c-b0e037f0ae8d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:07.702817 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-fffe8ec7-42a6-4466-928c-b0e037f0ae8d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:07.850695 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-fffe8ec7-42a6-4466-928c-b0e037f0ae8d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:21:07.859054 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-fffe8ec7-42a6-4466-928c-b0e037f0ae8d tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1452 microversion: 2.1 time: 0.169624 Jun 16 18:21:07.860349 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 583/1165] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:07 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:10.382716 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-f022de17-210e-4545-bed0-b10da6e6a8a2 req-3f39398b-480b-43e6-8515-399ff2620988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eaa76e3-7d8a-4702-bcca-4d870e086221", "tag": "b980ea2b-3e6e-4f83-93ba-c30098a1a716"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:10.395300 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-f022de17-210e-4545-bed0-b10da6e6a8a2 req-3f39398b-480b-43e6-8515-399ff2620988 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:10.395765 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-f022de17-210e-4545-bed0-b10da6e6a8a2 req-3f39398b-480b-43e6-8515-399ff2620988 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:10.411751 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-f022de17-210e-4545-bed0-b10da6e6a8a2 req-3f39398b-480b-43e6-8515-399ff2620988 service nova] Creating event network-changed:b980ea2b-3e6e-4f83-93ba-c30098a1a716 for instance 8eaa76e3-7d8a-4702-bcca-4d870e086221 on hv-cinder-83754 Jun 16 18:21:10.417862 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-f022de17-210e-4545-bed0-b10da6e6a8a2 req-3f39398b-480b-43e6-8515-399ff2620988 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038675 Jun 16 18:21:10.418418 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 583/1166] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:25.663821 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-50360c4c-70f1-4cd2-97c6-e426c2300ef7 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:25.664436 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-50360c4c-70f1-4cd2-97c6-e426c2300ef7 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:25.667099 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=19 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:21:25.667898 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:21:25.673593 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-50360c4c-70f1-4cd2-97c6-e426c2300ef7 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:25.674045 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-50360c4c-70f1-4cd2-97c6-e426c2300ef7 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:25.674826 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-50360c4c-70f1-4cd2-97c6-e426c2300ef7 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:25.675264 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-50360c4c-70f1-4cd2-97c6-e426c2300ef7 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:25.760503 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-50360c4c-70f1-4cd2-97c6-e426c2300ef7 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lazy-loading 'services' on Instance uuid 95d95db9-2ab3-46b5-b70e-346b739ea0de {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:21:26.008268 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-50360c4c-70f1-4cd2-97c6-e426c2300ef7 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de/os-volume_attachments/35f19efb-19e3-441f-99f7-eac790ada889" status: 202 len: 0 microversion: 2.1 time: 0.348230 Jun 16 18:21:26.008913 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 584/1167] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jun 16 18:21:25 2022] DELETE /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de/os-volume_attachments/35f19efb-19e3-441f-99f7-eac790ada889 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:21:28.197550 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=23 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:21:28.198206 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=74 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:21:28.202804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4346e256-593f-4c26-9e0a-30ab974fc605 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:28.203528 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4346e256-593f-4c26-9e0a-30ab974fc605 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:28.210017 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4346e256-593f-4c26-9e0a-30ab974fc605 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:28.213715 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4346e256-593f-4c26-9e0a-30ab974fc605 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:28.213715 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4346e256-593f-4c26-9e0a-30ab974fc605 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:28.213715 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4346e256-593f-4c26-9e0a-30ab974fc605 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:28.240036 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4346e256-593f-4c26-9e0a-30ab974fc605 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Going to try to terminate instance {{(pid=118162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:21:28.612277 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4346e256-593f-4c26-9e0a-30ab974fc605 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 204 len: 0 microversion: 2.1 time: 0.416099 Jun 16 18:21:28.612876 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 584/1168] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:21:28 2022] DELETE /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:21:28.622269 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b1fe3d80-a04c-4541-9f25-1ed91a37c277 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:28.622963 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b1fe3d80-a04c-4541-9f25-1ed91a37c277 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:28.629893 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b1fe3d80-a04c-4541-9f25-1ed91a37c277 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:28.630335 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b1fe3d80-a04c-4541-9f25-1ed91a37c277 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:28.631096 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b1fe3d80-a04c-4541-9f25-1ed91a37c277 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:28.631568 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b1fe3d80-a04c-4541-9f25-1ed91a37c277 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:28.913202 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b1fe3d80-a04c-4541-9f25-1ed91a37c277 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:21:28.920758 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b1fe3d80-a04c-4541-9f25-1ed91a37c277 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1514 microversion: 2.1 time: 0.303420 Jun 16 18:21:28.921814 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 585/1169] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:28 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:29.939518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2f91670f-31f0-4bbe-8d05-99e8990eb099 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:29.940287 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2f91670f-31f0-4bbe-8d05-99e8990eb099 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:29.948098 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f91670f-31f0-4bbe-8d05-99e8990eb099 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:29.948556 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f91670f-31f0-4bbe-8d05-99e8990eb099 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:29.949337 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f91670f-31f0-4bbe-8d05-99e8990eb099 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:29.949769 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2f91670f-31f0-4bbe-8d05-99e8990eb099 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:30.181514 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2f91670f-31f0-4bbe-8d05-99e8990eb099 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:21:30.190273 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2f91670f-31f0-4bbe-8d05-99e8990eb099 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1514 microversion: 2.1 time: 0.255265 Jun 16 18:21:30.190774 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 585/1170] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:29 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1514 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:31.210849 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9b00bae3-9ea6-4bda-a557-eb82652cc9f5 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:31.212025 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9b00bae3-9ea6-4bda-a557-eb82652cc9f5 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:31.225675 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9b00bae3-9ea6-4bda-a557-eb82652cc9f5 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:31.226166 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9b00bae3-9ea6-4bda-a557-eb82652cc9f5 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:31.227316 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9b00bae3-9ea6-4bda-a557-eb82652cc9f5 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:31.227449 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9b00bae3-9ea6-4bda-a557-eb82652cc9f5 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:31.380706 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9b00bae3-9ea6-4bda-a557-eb82652cc9f5 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:21:31.389120 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9b00bae3-9ea6-4bda-a557-eb82652cc9f5 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1514 microversion: 2.1 time: 0.185328 Jun 16 18:21:31.392930 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 586/1171] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:31 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:31.478544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-4416a9f8-a508-4777-ae8b-45db6a77dd6b req-3b23b0f0-51ef-437e-a178-cf5538853178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d95db9-2ab3-46b5-b70e-346b739ea0de", "name": "network-vif-deleted", "tag": "b63930da-5493-4109-96a2-372263025ac0"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:21:31.488026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-4416a9f8-a508-4777-ae8b-45db6a77dd6b req-3b23b0f0-51ef-437e-a178-cf5538853178 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:31.488476 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-4416a9f8-a508-4777-ae8b-45db6a77dd6b req-3b23b0f0-51ef-437e-a178-cf5538853178 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:31.501748 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-4416a9f8-a508-4777-ae8b-45db6a77dd6b req-3b23b0f0-51ef-437e-a178-cf5538853178 service nova] Creating event network-vif-deleted:b63930da-5493-4109-96a2-372263025ac0 for instance 95d95db9-2ab3-46b5-b70e-346b739ea0de on hv-cinder-83754 Jun 16 18:21:31.507327 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-4416a9f8-a508-4777-ae8b-45db6a77dd6b req-3b23b0f0-51ef-437e-a178-cf5538853178 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032682 Jun 16 18:21:31.508057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 586/1172] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:21:32.409209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-d55c580c-eeee-4835-b6c5-afffd426f994 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:32.409756 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-d55c580c-eeee-4835-b6c5-afffd426f994 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:32.418660 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d55c580c-eeee-4835-b6c5-afffd426f994 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:32.419117 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d55c580c-eeee-4835-b6c5-afffd426f994 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:32.419917 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d55c580c-eeee-4835-b6c5-afffd426f994 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:32.420350 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d55c580c-eeee-4835-b6c5-afffd426f994 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:32.458620 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d55c580c-eeee-4835-b6c5-afffd426f994 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:32.459129 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-d55c580c-eeee-4835-b6c5-afffd426f994 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:32.459651 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-d55c580c-eeee-4835-b6c5-afffd426f994 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lazy-loading 'fault' on Instance uuid 95d95db9-2ab3-46b5-b70e-346b739ea0de {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:21:32.513695 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-d55c580c-eeee-4835-b6c5-afffd426f994 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fca3484e66343849b9efcd87c17b1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3974a2bdfca4093986a7ca6cd926d58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:21:32.527791 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-d55c580c-eeee-4835-b6c5-afffd426f994 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 200 len: 1309 microversion: 2.1 time: 0.123208 Jun 16 18:21:32.528813 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 587/1173] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:32 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 1309 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:21:33.548238 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4df955ca-4c07-46dc-9572-df6495e9c202 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:21:33.548908 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4df955ca-4c07-46dc-9572-df6495e9c202 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] [instance: 95d95db9-2ab3-46b5-b70e-346b739ea0de] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:21:33.556033 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4df955ca-4c07-46dc-9572-df6495e9c202 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:33.556482 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4df955ca-4c07-46dc-9572-df6495e9c202 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:33.557376 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4df955ca-4c07-46dc-9572-df6495e9c202 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:21:33.557725 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4df955ca-4c07-46dc-9572-df6495e9c202 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:21:33.572460 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-4df955ca-4c07-46dc-9572-df6495e9c202 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] HTTP exception thrown: Instance 95d95db9-2ab3-46b5-b70e-346b739ea0de could not be found. Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4df955ca-4c07-46dc-9572-df6495e9c202 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Request method failure captured: Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de HTTP/1.1 Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3QLRNbYB-DQ60H159ZmsezJvQ65Pnw6YCNx2WBEf5jaRJzy4cSQFejK6ndt9l-Mn-qwccTz9PrasnGkJDgniKbmEwz8cUdmB1VKJzc2xFCz4MNK2RszfY570Kyl2ijBTsfUDNWBMxIq6u92_fTPILcNJa9OxDCMDpZ0gXvAMoIL-3I Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: c3974a2bdfca4093986a7ca6cd926d58 Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1707455906 Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:21:33.574115 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:21:33.575940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c3974a2bdfca4093986a7ca6cd926d58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c3974a2bdfca4093986a7ca6cd926d58"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c3974a2bdfca4093986a7ca6cd926d58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c3974a2bdfca4093986a7ca6cd926d58"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:21:33.575940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-VolumesSnapshotTestJSON-1707455906 Jun 16 18:21:33.575940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: c3974a2bdfca4093986a7ca6cd926d58 Jun 16 18:21:33.575940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1707455906 Jun 16 18:21:33.575940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-VolumesSnapshotTestJSON-1707455906-project Jun 16 18:21:33.575940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:21:33.575940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:21:33.575940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: 4fca3484e66343849b9efcd87c17b1ac Jun 16 18:21:33.575940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-VolumesSnapshotTestJSON-1707455906-project Jun 16 18:21:33.575940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:21:33.575940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 95d95db9-2ab3-46b5-b70e-346b739ea0de could not be found. Jun 16 18:21:33.575940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '95d95db9-2ab3-46b5-b70e-346b739ea0de'} Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d95db9-2ab3-46b5-b70e-346b739ea0de could not be found. Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:21:33.576927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d95db9-2ab3-46b5-b70e-346b739ea0de could not be found. Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d95db9-2ab3-46b5-b70e-346b739ea0de could not be found. Jun 16 18:21:33.578888 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:21:33.580654 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4df955ca-4c07-46dc-9572-df6495e9c202 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] Returning 404 to user: Instance 95d95db9-2ab3-46b5-b70e-346b739ea0de could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:21:33.580654 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4df955ca-4c07-46dc-9572-df6495e9c202 tempest-VolumesSnapshotTestJSON-1707455906 tempest-VolumesSnapshotTestJSON-1707455906-project] 10.222.0.58 "GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de" status: 404 len: 111 microversion: 2.1 time: 0.032371 Jun 16 18:21:33.580654 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 587/1174] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:21:33 2022] GET /compute/v2.1/servers/95d95db9-2ab3-46b5-b70e-346b739ea0de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:22:38.439811 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=10 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:22:38.440859 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:22:38.444850 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-42fb6fab-341a-41df-88b3-637c84f8aeea tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Action: 'create', calling method: .version_select at 0x7f9c30644160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-852534607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/S75ETRL4063cV6/6UVUfPYaKUCVu5PGpHYwZPAcDaEfZi7QnY3PCVfFbZJnCgL5ba9ALrRE+AooKk1OwGtNY9vpsA7JJqR1FiHDiJNYQz4QE8kSF2HbCvMz8tjEKhDg=="}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:22:38.460803 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-42fb6fab-341a-41df-88b3-637c84f8aeea tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Getting quotas for project 60fd87cc7cb24ee0a0006089d4b13084. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:22:38.464461 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-42fb6fab-341a-41df-88b3-637c84f8aeea tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Getting quotas for user e3f73a99241e449bbee5e0a28878e80c and project 60fd87cc7cb24ee0a0006089d4b13084. Resources: {'key_pairs'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:22:38.610124 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-42fb6fab-341a-41df-88b3-637c84f8aeea tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.172150 Jun 16 18:22:38.610717 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 588/1175] 10.222.0.58 () {60 vars in 1158 bytes} [Thu Jun 16 18:22:38 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:22:38.662008 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:22:38.662768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:22:38.666704 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-751916705", "imageRef": "024ec7b2-6fb2-4968-a96a-47ad56835887", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-852534607", "networks": [{"uuid": "d74e4617-375b-4ab4-843f-9137ced2658f"}]}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:22:38.723460 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.network.neutron [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] validate_networks() for [('d74e4617-375b-4ab4-843f-9137ced2658f', None, None, None, None, None)] {{(pid=118162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:22:39.125612 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Flavor limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:22:39.134825 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Image limits 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:22:39.134825 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Flavor pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:22:39.134825 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Image pref 0:0:0 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:22:39.134825 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.virt.hardware [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:22:39.136776 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:39.137226 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:39.138062 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:39.138559 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:39.156446 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Getting quotas for project 60fd87cc7cb24ee0a0006089d4b13084. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:22:39.160591 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.quota [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Getting quotas for user e3f73a99241e449bbee5e0a28878e80c and project 60fd87cc7cb24ee0a0006089d4b13084. Resources: {'ram', 'instances', 'cores'} {{(pid=118162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:22:39.172466 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Going to run 1 instances... {{(pid=118162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:22:39.174688 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='024ec7b2-6fb2-4968-a96a-47ad56835887',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:22:39.386067 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-46813d3f-5e8b-480d-8b79-cda9457ff49b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725639 Jun 16 18:22:39.386708 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 588/1176] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:22:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:22:39.398002 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-42861477-6a0b-46a8-85b6-dd58519268b6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:39.398716 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-42861477-6a0b-46a8-85b6-dd58519268b6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:39.457290 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-42861477-6a0b-46a8-85b6-dd58519268b6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:39.465178 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-42861477-6a0b-46a8-85b6-dd58519268b6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1257 microversion: 2.1 time: 0.071161 Jun 16 18:22:39.465742 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 589/1177] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:39 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:40.489794 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2847c3f2-a008-442b-af61-70e871c095bb tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:40.490404 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2847c3f2-a008-442b-af61-70e871c095bb tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:40.543724 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2847c3f2-a008-442b-af61-70e871c095bb tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:40.551741 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2847c3f2-a008-442b-af61-70e871c095bb tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1257 microversion: 2.1 time: 0.066747 Jun 16 18:22:40.552351 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 589/1178] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:40 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:41.568349 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-24bce07e-2a48-40b7-9cef-d770e8f521e3 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:41.568915 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-24bce07e-2a48-40b7-9cef-d770e8f521e3 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:41.623795 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-24bce07e-2a48-40b7-9cef-d770e8f521e3 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:41.630566 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-24bce07e-2a48-40b7-9cef-d770e8f521e3 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1257 microversion: 2.1 time: 0.066441 Jun 16 18:22:41.631127 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 590/1179] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:41 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:42.647756 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-72052f7e-85ee-4f3c-b3ce-622456168303 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:42.648429 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-72052f7e-85ee-4f3c-b3ce-622456168303 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:42.655872 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-72052f7e-85ee-4f3c-b3ce-622456168303 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:42.656318 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-72052f7e-85ee-4f3c-b3ce-622456168303 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:42.657086 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-72052f7e-85ee-4f3c-b3ce-622456168303 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:42.657518 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-72052f7e-85ee-4f3c-b3ce-622456168303 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:42.723161 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-72052f7e-85ee-4f3c-b3ce-622456168303 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:42.730694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-72052f7e-85ee-4f3c-b3ce-622456168303 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1253 microversion: 2.1 time: 0.086963 Jun 16 18:22:42.731244 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 590/1180] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:42 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1253 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:43.754388 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c7dad0c0-08f3-4961-81f2-f6faa70be693 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:43.755140 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c7dad0c0-08f3-4961-81f2-f6faa70be693 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:43.761573 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c7dad0c0-08f3-4961-81f2-f6faa70be693 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:43.762024 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c7dad0c0-08f3-4961-81f2-f6faa70be693 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:43.763477 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c7dad0c0-08f3-4961-81f2-f6faa70be693 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:43.763916 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c7dad0c0-08f3-4961-81f2-f6faa70be693 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:43.843467 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c7dad0c0-08f3-4961-81f2-f6faa70be693 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:43.851306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c7dad0c0-08f3-4961-81f2-f6faa70be693 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1317 microversion: 2.1 time: 0.100845 Jun 16 18:22:43.897141 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 591/1181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:43 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1317 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:44.869865 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9fafddd6-c98e-4c2d-8766-95a15c9bd016 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:44.870691 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9fafddd6-c98e-4c2d-8766-95a15c9bd016 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:44.878780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9fafddd6-c98e-4c2d-8766-95a15c9bd016 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:44.879227 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9fafddd6-c98e-4c2d-8766-95a15c9bd016 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:44.880132 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9fafddd6-c98e-4c2d-8766-95a15c9bd016 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:44.880612 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9fafddd6-c98e-4c2d-8766-95a15c9bd016 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:45.081257 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9fafddd6-c98e-4c2d-8766-95a15c9bd016 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:45.091343 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9fafddd6-c98e-4c2d-8766-95a15c9bd016 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.225494 Jun 16 18:22:45.094917 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 591/1182] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:44 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:46.111056 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6f40bc9e-1976-4a88-ab1a-40217075d031 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:46.113083 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6f40bc9e-1976-4a88-ab1a-40217075d031 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:46.127150 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f40bc9e-1976-4a88-ab1a-40217075d031 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:46.129204 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f40bc9e-1976-4a88-ab1a-40217075d031 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:46.130833 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f40bc9e-1976-4a88-ab1a-40217075d031 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:46.131541 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6f40bc9e-1976-4a88-ab1a-40217075d031 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:46.408104 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-8676240c-4d74-44cf-88db-ee590fb38917 req-1d5c3fe8-a89a-4a2e-ba0b-01acf1f1eb34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13282fd3-f81a-41ec-a714-aca0bbee3325", "tag": "68704890-0b9c-4d29-b937-474b57bb62e2"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:22:46.435094 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-8676240c-4d74-44cf-88db-ee590fb38917 req-1d5c3fe8-a89a-4a2e-ba0b-01acf1f1eb34 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:46.435595 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-8676240c-4d74-44cf-88db-ee590fb38917 req-1d5c3fe8-a89a-4a2e-ba0b-01acf1f1eb34 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:46.454477 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-8676240c-4d74-44cf-88db-ee590fb38917 req-1d5c3fe8-a89a-4a2e-ba0b-01acf1f1eb34 service nova] Creating event network-changed:68704890-0b9c-4d29-b937-474b57bb62e2 for instance 13282fd3-f81a-41ec-a714-aca0bbee3325 on hv-cinder-83754 Jun 16 18:22:46.462529 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-8676240c-4d74-44cf-88db-ee590fb38917 req-1d5c3fe8-a89a-4a2e-ba0b-01acf1f1eb34 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288098 Jun 16 18:22:46.464151 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 592/1183] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:22:46.489986 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6f40bc9e-1976-4a88-ab1a-40217075d031 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:46.501640 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6f40bc9e-1976-4a88-ab1a-40217075d031 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.395369 Jun 16 18:22:46.502729 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 592/1184] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:46 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:47.519945 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-22037f15-66f2-4bbb-af83-5a1cb07fff4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:47.520638 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-22037f15-66f2-4bbb-af83-5a1cb07fff4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:47.527163 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-22037f15-66f2-4bbb-af83-5a1cb07fff4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:47.527633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-22037f15-66f2-4bbb-af83-5a1cb07fff4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:47.528400 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-22037f15-66f2-4bbb-af83-5a1cb07fff4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:47.528839 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-22037f15-66f2-4bbb-af83-5a1cb07fff4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:47.704012 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-22037f15-66f2-4bbb-af83-5a1cb07fff4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:47.712474 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-22037f15-66f2-4bbb-af83-5a1cb07fff4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.197178 Jun 16 18:22:47.713048 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 593/1185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:47 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:48.728671 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2c9c3fd0-b829-4637-9011-b2644565157a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:48.729395 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2c9c3fd0-b829-4637-9011-b2644565157a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:48.737334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2c9c3fd0-b829-4637-9011-b2644565157a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:48.737789 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2c9c3fd0-b829-4637-9011-b2644565157a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:48.738570 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2c9c3fd0-b829-4637-9011-b2644565157a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:48.739010 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2c9c3fd0-b829-4637-9011-b2644565157a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:48.889835 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2c9c3fd0-b829-4637-9011-b2644565157a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:48.899094 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2c9c3fd0-b829-4637-9011-b2644565157a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.174318 Jun 16 18:22:48.900255 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 593/1186] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:48 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:49.916266 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-724fe2b1-0c38-41eb-9b6d-76ea636dcd9a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:49.917517 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-724fe2b1-0c38-41eb-9b6d-76ea636dcd9a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:49.922490 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:22:49.927507 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-724fe2b1-0c38-41eb-9b6d-76ea636dcd9a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:49.927867 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-724fe2b1-0c38-41eb-9b6d-76ea636dcd9a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:49.928645 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-724fe2b1-0c38-41eb-9b6d-76ea636dcd9a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:49.929074 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-724fe2b1-0c38-41eb-9b6d-76ea636dcd9a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:50.071764 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-724fe2b1-0c38-41eb-9b6d-76ea636dcd9a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:50.080632 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-724fe2b1-0c38-41eb-9b6d-76ea636dcd9a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.168475 Jun 16 18:22:50.081202 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 594/1187] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:49 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:51.098629 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6933fd56-66d9-4cb9-b8c4-faa18225083b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:51.099254 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6933fd56-66d9-4cb9-b8c4-faa18225083b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:51.110025 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6933fd56-66d9-4cb9-b8c4-faa18225083b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:51.110676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6933fd56-66d9-4cb9-b8c4-faa18225083b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:51.111803 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6933fd56-66d9-4cb9-b8c4-faa18225083b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:51.112529 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6933fd56-66d9-4cb9-b8c4-faa18225083b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:51.297605 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6933fd56-66d9-4cb9-b8c4-faa18225083b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:51.311940 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6933fd56-66d9-4cb9-b8c4-faa18225083b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.216719 Jun 16 18:22:51.312983 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 594/1188] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:51 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:52.331590 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-bdb0eb83-e8e7-4057-bd12-9c999ac4c311 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:52.334134 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-bdb0eb83-e8e7-4057-bd12-9c999ac4c311 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:52.344582 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=8 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:22:52.348508 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bdb0eb83-e8e7-4057-bd12-9c999ac4c311 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:52.349723 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bdb0eb83-e8e7-4057-bd12-9c999ac4c311 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:52.351562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bdb0eb83-e8e7-4057-bd12-9c999ac4c311 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:52.352603 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bdb0eb83-e8e7-4057-bd12-9c999ac4c311 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:52.596478 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-bdb0eb83-e8e7-4057-bd12-9c999ac4c311 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:52.607096 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-bdb0eb83-e8e7-4057-bd12-9c999ac4c311 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.281574 Jun 16 18:22:52.608081 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 595/1189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:52 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:53.627237 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1c6d9f20-c3a8-46f0-974e-bc65e9a7a259 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:53.627982 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1c6d9f20-c3a8-46f0-974e-bc65e9a7a259 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:53.629728 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=8 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:22:53.635081 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c6d9f20-c3a8-46f0-974e-bc65e9a7a259 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:53.635619 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c6d9f20-c3a8-46f0-974e-bc65e9a7a259 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:53.636426 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c6d9f20-c3a8-46f0-974e-bc65e9a7a259 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:53.636893 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1c6d9f20-c3a8-46f0-974e-bc65e9a7a259 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:53.804902 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1c6d9f20-c3a8-46f0-974e-bc65e9a7a259 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:53.813138 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1c6d9f20-c3a8-46f0-974e-bc65e9a7a259 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.189739 Jun 16 18:22:53.814370 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 595/1190] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:53 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:54.836193 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-d12c948f-bf5c-4c9e-9b2f-29bbcba61859 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:54.836866 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-d12c948f-bf5c-4c9e-9b2f-29bbcba61859 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:54.844240 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d12c948f-bf5c-4c9e-9b2f-29bbcba61859 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:54.844682 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d12c948f-bf5c-4c9e-9b2f-29bbcba61859 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:54.845449 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d12c948f-bf5c-4c9e-9b2f-29bbcba61859 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:54.845876 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-d12c948f-bf5c-4c9e-9b2f-29bbcba61859 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:55.006881 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-d12c948f-bf5c-4c9e-9b2f-29bbcba61859 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:55.014804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-d12c948f-bf5c-4c9e-9b2f-29bbcba61859 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.183223 Jun 16 18:22:55.018693 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 596/1191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:54 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:22:56.033862 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-9b03aa2c-638d-4445-9562-e40970915cda tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:56.034740 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-9b03aa2c-638d-4445-9562-e40970915cda tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:56.042788 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9b03aa2c-638d-4445-9562-e40970915cda tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:56.043870 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9b03aa2c-638d-4445-9562-e40970915cda tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:56.044954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9b03aa2c-638d-4445-9562-e40970915cda tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:56.045466 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-9b03aa2c-638d-4445-9562-e40970915cda tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:56.187547 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-9b03aa2c-638d-4445-9562-e40970915cda tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:56.199029 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-9b03aa2c-638d-4445-9562-e40970915cda tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.169892 Jun 16 18:22:56.200493 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 596/1192] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:56 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:22:57.227089 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-10907337-24ce-4ac1-a9a0-9098ed280768 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:57.228271 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-10907337-24ce-4ac1-a9a0-9098ed280768 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:57.239790 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-10907337-24ce-4ac1-a9a0-9098ed280768 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:57.240602 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-10907337-24ce-4ac1-a9a0-9098ed280768 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:57.242015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-10907337-24ce-4ac1-a9a0-9098ed280768 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:57.242817 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-10907337-24ce-4ac1-a9a0-9098ed280768 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:57.488653 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-10907337-24ce-4ac1-a9a0-9098ed280768 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:57.497994 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-10907337-24ce-4ac1-a9a0-9098ed280768 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.278020 Jun 16 18:22:57.498567 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 597/1193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:57 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:22:58.515170 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1ff9b48b-f5c5-4008-a84b-bf7830fef58b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:58.515917 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1ff9b48b-f5c5-4008-a84b-bf7830fef58b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:58.523030 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1ff9b48b-f5c5-4008-a84b-bf7830fef58b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:58.523500 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1ff9b48b-f5c5-4008-a84b-bf7830fef58b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:58.524258 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1ff9b48b-f5c5-4008-a84b-bf7830fef58b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:58.524681 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1ff9b48b-f5c5-4008-a84b-bf7830fef58b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:58.672067 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1ff9b48b-f5c5-4008-a84b-bf7830fef58b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:58.679653 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1ff9b48b-f5c5-4008-a84b-bf7830fef58b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.169310 Jun 16 18:22:58.680218 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 597/1194] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:58 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:22:59.702092 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2ee1f639-e65b-404c-991d-a2443da2c809 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:22:59.703197 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2ee1f639-e65b-404c-991d-a2443da2c809 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:22:59.715302 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2ee1f639-e65b-404c-991d-a2443da2c809 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:59.716225 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2ee1f639-e65b-404c-991d-a2443da2c809 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:59.718378 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2ee1f639-e65b-404c-991d-a2443da2c809 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:22:59.718858 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2ee1f639-e65b-404c-991d-a2443da2c809 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:22:59.893962 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2ee1f639-e65b-404c-991d-a2443da2c809 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:22:59.904773 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2ee1f639-e65b-404c-991d-a2443da2c809 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.209448 Jun 16 18:22:59.905457 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 598/1195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:22:59 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:23:00.926239 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-bc81f2ea-92f6-4294-89dc-58d5bcf12674 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:00.927086 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-bc81f2ea-92f6-4294-89dc-58d5bcf12674 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:00.939223 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bc81f2ea-92f6-4294-89dc-58d5bcf12674 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:00.939710 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bc81f2ea-92f6-4294-89dc-58d5bcf12674 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:00.940941 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bc81f2ea-92f6-4294-89dc-58d5bcf12674 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:00.941376 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-bc81f2ea-92f6-4294-89dc-58d5bcf12674 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:01.135130 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-bc81f2ea-92f6-4294-89dc-58d5bcf12674 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:01.143738 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-bc81f2ea-92f6-4294-89dc-58d5bcf12674 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.224278 Jun 16 18:23:01.144311 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 598/1196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:00 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:02.160357 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-e914b6a8-dc03-46a3-88e1-520db130fccf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:02.161181 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-e914b6a8-dc03-46a3-88e1-520db130fccf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:02.168862 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e914b6a8-dc03-46a3-88e1-520db130fccf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:02.169180 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e914b6a8-dc03-46a3-88e1-520db130fccf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:02.169903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e914b6a8-dc03-46a3-88e1-520db130fccf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:02.170343 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-e914b6a8-dc03-46a3-88e1-520db130fccf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:02.310172 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-e914b6a8-dc03-46a3-88e1-520db130fccf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:02.318155 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-e914b6a8-dc03-46a3-88e1-520db130fccf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.161622 Jun 16 18:23:02.318740 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 599/1197] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:02 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:02.852861 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-af7ac863-dbd3-40a4-8ed5-a7343bdd125a req-54e077a2-f57c-4b2e-9f86-0104bab2177e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13282fd3-f81a-41ec-a714-aca0bbee3325", "name": "network-vif-plugged", "status": "completed", "tag": "68704890-0b9c-4d29-b937-474b57bb62e2"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:23:02.862971 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-af7ac863-dbd3-40a4-8ed5-a7343bdd125a req-54e077a2-f57c-4b2e-9f86-0104bab2177e service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:02.863452 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-af7ac863-dbd3-40a4-8ed5-a7343bdd125a req-54e077a2-f57c-4b2e-9f86-0104bab2177e service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:02.876695 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-af7ac863-dbd3-40a4-8ed5-a7343bdd125a req-54e077a2-f57c-4b2e-9f86-0104bab2177e service nova] Creating event network-vif-plugged:68704890-0b9c-4d29-b937-474b57bb62e2 for instance 13282fd3-f81a-41ec-a714-aca0bbee3325 on hv-cinder-83754 Jun 16 18:23:02.882054 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-af7ac863-dbd3-40a4-8ed5-a7343bdd125a req-54e077a2-f57c-4b2e-9f86-0104bab2177e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035150 Jun 16 18:23:02.882743 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 599/1198] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:23:03.339248 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3662b4f6-7ad0-4cc4-b406-e6c1a71bcc6b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:03.339887 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3662b4f6-7ad0-4cc4-b406-e6c1a71bcc6b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:03.346902 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3662b4f6-7ad0-4cc4-b406-e6c1a71bcc6b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:03.347350 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3662b4f6-7ad0-4cc4-b406-e6c1a71bcc6b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:03.348143 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3662b4f6-7ad0-4cc4-b406-e6c1a71bcc6b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:03.348576 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3662b4f6-7ad0-4cc4-b406-e6c1a71bcc6b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:03.541063 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-3662b4f6-7ad0-4cc4-b406-e6c1a71bcc6b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:03.552262 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3662b4f6-7ad0-4cc4-b406-e6c1a71bcc6b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.216700 Jun 16 18:23:03.553047 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 600/1199] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:03 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:04.581759 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0d074bab-3a51-4480-af99-e72c13dae72d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:04.583052 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0d074bab-3a51-4480-af99-e72c13dae72d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:04.591909 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0d074bab-3a51-4480-af99-e72c13dae72d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:04.592350 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0d074bab-3a51-4480-af99-e72c13dae72d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:04.593122 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0d074bab-3a51-4480-af99-e72c13dae72d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:04.593543 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0d074bab-3a51-4480-af99-e72c13dae72d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:04.737369 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0d074bab-3a51-4480-af99-e72c13dae72d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:04.744765 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0d074bab-3a51-4480-af99-e72c13dae72d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1357 microversion: 2.1 time: 0.171182 Jun 16 18:23:04.751618 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 600/1200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:04 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:05.762920 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-9b838df8-7cda-42ff-a7a0-c92513f28de5 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:05.763561 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-9b838df8-7cda-42ff-a7a0-c92513f28de5 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:05.771469 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9b838df8-7cda-42ff-a7a0-c92513f28de5 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:05.771952 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9b838df8-7cda-42ff-a7a0-c92513f28de5 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:05.772726 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9b838df8-7cda-42ff-a7a0-c92513f28de5 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:05.773154 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-9b838df8-7cda-42ff-a7a0-c92513f28de5 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:05.917762 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-9b838df8-7cda-42ff-a7a0-c92513f28de5 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:05.926900 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-9b838df8-7cda-42ff-a7a0-c92513f28de5 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1547 microversion: 2.1 time: 0.168225 Jun 16 18:23:05.927730 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 601/1201] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:05 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:05.946128 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-dbeea975-5b3c-4a54-bda8-b794db0ecffc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:05.946907 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-dbeea975-5b3c-4a54-bda8-b794db0ecffc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:05.958222 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dbeea975-5b3c-4a54-bda8-b794db0ecffc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:05.958674 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dbeea975-5b3c-4a54-bda8-b794db0ecffc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:05.959492 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dbeea975-5b3c-4a54-bda8-b794db0ecffc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:05.959929 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-dbeea975-5b3c-4a54-bda8-b794db0ecffc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:06.111213 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-dbeea975-5b3c-4a54-bda8-b794db0ecffc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:06.118982 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-dbeea975-5b3c-4a54-bda8-b794db0ecffc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1547 microversion: 2.1 time: 0.177243 Jun 16 18:23:06.119576 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 601/1202] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:05 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:06.134800 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1148c8ea-1e11-47b9-898f-b518add182f6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:06.138507 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1148c8ea-1e11-47b9-898f-b518add182f6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:06.139273 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1148c8ea-1e11-47b9-898f-b518add182f6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Searching by: {'deleted': False, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084'} {{(pid=118162) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 18:23:06.146311 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1148c8ea-1e11-47b9-898f-b518add182f6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:06.146757 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1148c8ea-1e11-47b9-898f-b518add182f6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:06.147592 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1148c8ea-1e11-47b9-898f-b518add182f6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:06.148024 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1148c8ea-1e11-47b9-898f-b518add182f6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:06.252709 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.multi_cell_list [None req-1148c8ea-1e11-47b9-898f-b518add182f6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118162) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 18:23:06.354989 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1148c8ea-1e11-47b9-898f-b518add182f6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.223832 Jun 16 18:23:06.355581 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 602/1203] 10.222.0.58 () {58 vars in 1124 bytes} [Thu Jun 16 18:23:06 2022] GET /compute/v2.1/servers => generated 342 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:23:06.366523 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-e31dfc79-c046-49d9-b115-9eff3e2aa147 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:06.367114 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-e31dfc79-c046-49d9-b115-9eff3e2aa147 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:06.373678 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e31dfc79-c046-49d9-b115-9eff3e2aa147 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:06.374122 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e31dfc79-c046-49d9-b115-9eff3e2aa147 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:06.374884 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e31dfc79-c046-49d9-b115-9eff3e2aa147 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:06.375316 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-e31dfc79-c046-49d9-b115-9eff3e2aa147 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:06.529238 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-e31dfc79-c046-49d9-b115-9eff3e2aa147 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:06.541425 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-e31dfc79-c046-49d9-b115-9eff3e2aa147 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1547 microversion: 2.1 time: 0.178451 Jun 16 18:23:06.542307 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 602/1204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:06 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1547 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:23:09.697535 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-02f5b8d9-b3c7-42f6-a161-1bf9f684de44 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b44834e5-3175-43f8-bc5a-f4a24a1e065d"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:23:09.698656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-02f5b8d9-b3c7-42f6-a161-1bf9f684de44 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:09.701904 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:23:09.706712 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-02f5b8d9-b3c7-42f6-a161-1bf9f684de44 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:09.707154 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-02f5b8d9-b3c7-42f6-a161-1bf9f684de44 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:09.708206 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-02f5b8d9-b3c7-42f6-a161-1bf9f684de44 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:09.708638 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-02f5b8d9-b3c7-42f6-a161-1bf9f684de44 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:10.588358 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:23:10.810715 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-02f5b8d9-b3c7-42f6-a161-1bf9f684de44 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "POST /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.118638 Jun 16 18:23:10.811561 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 603/1205] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Jun 16 18:23:09 2022] POST /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments => generated 194 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:23:21.609070 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-874838100", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-629434427", "security_groups": [{"name": "tempest-secgroup-smoke-1571274317"}], "block_device_mapping_v2": [{"uuid": "ae322442-4cfc-45ab-8ff7-99fd03eb58b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "abadf347-d0dd-4369-8210-959891491bfa"}]}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:23:21.625014 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:23:21.626126 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=68 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:23:21.784683 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.network.neutron [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] validate_networks() for [('abadf347-d0dd-4369-8210-959891491bfa', None, None, None, None, None)] {{(pid=118161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:23:22.197026 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Flavor limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:23:22.197774 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Image limits 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:23:22.198322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Flavor pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:23:22.198322 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Image pref 0:0:0 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:23:22.198874 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.virt.hardware [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:23:22.215896 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:22.216485 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:22.217441 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:22.217935 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:22.237644 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Getting quotas for project bff5c01fd0ab4348b4704765f0195d50. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:23:22.241824 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.quota [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Getting quotas for user f8cc86b384df4223a800838a3d386d3f and project bff5c01fd0ab4348b4704765f0195d50. Resources: {'ram', 'instances', 'cores'} {{(pid=118161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:23:22.320642 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Going to run 1 instances... {{(pid=118161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:23:22.323223 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae322442-4cfc-45ab-8ff7-99fd03eb58b0',volume_size=None,volume_type=None)] {{(pid=118161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:23:22.918920 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell0:SELECT=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:23:22.920164 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:23:22.921025 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:23:22.925760 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0567208b-7eef-4f01-a072-41d3a50bfe7d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:22.933881 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0567208b-7eef-4f01-a072-41d3a50bfe7d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:22.933881 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0567208b-7eef-4f01-a072-41d3a50bfe7d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:22.934153 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0567208b-7eef-4f01-a072-41d3a50bfe7d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:22.935050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0567208b-7eef-4f01-a072-41d3a50bfe7d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:22.935604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0567208b-7eef-4f01-a072-41d3a50bfe7d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:23.026149 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a5d69bdb-c84b-4cc9-b4cc-75d796f0285b tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.424584 Jun 16 18:23:23.032982 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 603/1206] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Jun 16 18:23:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:23:23.043966 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3efbea16-f8ee-4fb1-9a50-c8c2773ac14e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:23.045079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3efbea16-f8ee-4fb1-9a50-c8c2773ac14e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:23.130969 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3efbea16-f8ee-4fb1-9a50-c8c2773ac14e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:23.139008 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3efbea16-f8ee-4fb1-9a50-c8c2773ac14e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1093 microversion: 2.1 time: 0.103244 Jun 16 18:23:23.140047 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 604/1207] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:23 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1093 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:23.159931 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0567208b-7eef-4f01-a072-41d3a50bfe7d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:23.168698 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0567208b-7eef-4f01-a072-41d3a50bfe7d tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1593 microversion: 2.1 time: 0.255190 Jun 16 18:23:23.169470 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 604/1208] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:22 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1593 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:24.170581 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-a9d5f858-f294-4aad-8b3d-2e1abd75ea26 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:24.171249 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-a9d5f858-f294-4aad-8b3d-2e1abd75ea26 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:24.328647 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-a9d5f858-f294-4aad-8b3d-2e1abd75ea26 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:24.340353 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-a9d5f858-f294-4aad-8b3d-2e1abd75ea26 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1093 microversion: 2.1 time: 0.173430 Jun 16 18:23:24.341125 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 605/1209] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:24 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1093 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:23:24.891925 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:23:24.892498 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Thu Jun 16 18:23:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:23:25.360203 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a2540653-f898-4924-b203-ec3548a01739 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:25.360823 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a2540653-f898-4924-b203-ec3548a01739 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:25.368331 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a2540653-f898-4924-b203-ec3548a01739 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:25.368826 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a2540653-f898-4924-b203-ec3548a01739 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:25.369599 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a2540653-f898-4924-b203-ec3548a01739 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:25.370034 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a2540653-f898-4924-b203-ec3548a01739 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:25.483212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a2540653-f898-4924-b203-ec3548a01739 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:25.491068 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a2540653-f898-4924-b203-ec3548a01739 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1135 microversion: 2.1 time: 0.136298 Jun 16 18:23:25.491669 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 605/1210] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:25 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1135 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:26.142210 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-badd7bb9-b80c-4ef7-8b73-52af6d737a4c req-5c727c82-e6c5-4298-83e8-4e2f8ba02323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13282fd3-f81a-41ec-a714-aca0bbee3325", "tag": "68704890-0b9c-4d29-b937-474b57bb62e2"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:23:26.155182 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-badd7bb9-b80c-4ef7-8b73-52af6d737a4c req-5c727c82-e6c5-4298-83e8-4e2f8ba02323 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:26.155912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-badd7bb9-b80c-4ef7-8b73-52af6d737a4c req-5c727c82-e6c5-4298-83e8-4e2f8ba02323 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:26.175110 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-badd7bb9-b80c-4ef7-8b73-52af6d737a4c req-5c727c82-e6c5-4298-83e8-4e2f8ba02323 service nova] Creating event network-changed:68704890-0b9c-4d29-b937-474b57bb62e2 for instance 13282fd3-f81a-41ec-a714-aca0bbee3325 on hv-cinder-83754 Jun 16 18:23:26.181763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-badd7bb9-b80c-4ef7-8b73-52af6d737a4c req-5c727c82-e6c5-4298-83e8-4e2f8ba02323 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043235 Jun 16 18:23:26.184352 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 606/1211] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:23:26.510677 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2aea2224-6c1c-4d1c-979b-842619554661 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:26.515840 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2aea2224-6c1c-4d1c-979b-842619554661 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:26.521673 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2aea2224-6c1c-4d1c-979b-842619554661 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:26.522729 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2aea2224-6c1c-4d1c-979b-842619554661 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:26.523812 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2aea2224-6c1c-4d1c-979b-842619554661 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:26.524432 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2aea2224-6c1c-4d1c-979b-842619554661 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:26.638374 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2aea2224-6c1c-4d1c-979b-842619554661 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:26.658841 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2aea2224-6c1c-4d1c-979b-842619554661 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1191 microversion: 2.1 time: 0.152965 Jun 16 18:23:26.672063 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 606/1212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:26 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1191 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:27.686248 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-3587dd58-a22d-4df7-89b4-5fb44f64647a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:27.687047 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-3587dd58-a22d-4df7-89b4-5fb44f64647a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:27.697144 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3587dd58-a22d-4df7-89b4-5fb44f64647a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:27.697999 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3587dd58-a22d-4df7-89b4-5fb44f64647a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:27.700004 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3587dd58-a22d-4df7-89b4-5fb44f64647a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:27.700927 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-3587dd58-a22d-4df7-89b4-5fb44f64647a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:27.874417 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-3587dd58-a22d-4df7-89b4-5fb44f64647a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:27.883145 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-3587dd58-a22d-4df7-89b4-5fb44f64647a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1277 microversion: 2.1 time: 0.202303 Jun 16 18:23:27.884344 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 607/1213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:27 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:28.907074 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-71aac18d-c078-47f6-8802-c7d3c1d4d628 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:28.908744 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-71aac18d-c078-47f6-8802-c7d3c1d4d628 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:28.921615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-71aac18d-c078-47f6-8802-c7d3c1d4d628 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:28.922402 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-71aac18d-c078-47f6-8802-c7d3c1d4d628 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:28.923612 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-71aac18d-c078-47f6-8802-c7d3c1d4d628 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:28.924232 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-71aac18d-c078-47f6-8802-c7d3c1d4d628 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:29.083137 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-71aac18d-c078-47f6-8802-c7d3c1d4d628 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:29.102186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-71aac18d-c078-47f6-8802-c7d3c1d4d628 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1277 microversion: 2.1 time: 0.201152 Jun 16 18:23:29.102186 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 607/1214] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:28 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:29.218419 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-174a0a3b-a321-4a3a-bbe4-2a98404844e1 req-2f47f83a-9b81-44b4-9142-76d5f189da5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ee60a0-0ed0-4dd7-95e5-485558986d52", "tag": "79320d68-8728-4505-8872-70bd2eac8f26"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:23:29.228452 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-174a0a3b-a321-4a3a-bbe4-2a98404844e1 req-2f47f83a-9b81-44b4-9142-76d5f189da5c service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:29.229007 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-174a0a3b-a321-4a3a-bbe4-2a98404844e1 req-2f47f83a-9b81-44b4-9142-76d5f189da5c service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:29.244066 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-174a0a3b-a321-4a3a-bbe4-2a98404844e1 req-2f47f83a-9b81-44b4-9142-76d5f189da5c service nova] Creating event network-changed:79320d68-8728-4505-8872-70bd2eac8f26 for instance 17ee60a0-0ed0-4dd7-95e5-485558986d52 on hv-cinder-83754 Jun 16 18:23:29.249912 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-174a0a3b-a321-4a3a-bbe4-2a98404844e1 req-2f47f83a-9b81-44b4-9142-76d5f189da5c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130369 Jun 16 18:23:29.251397 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 608/1215] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:23:30.127359 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5355081f-af92-4c7b-a32c-a4ab87b19cf1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:30.128413 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5355081f-af92-4c7b-a32c-a4ab87b19cf1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:30.136457 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5355081f-af92-4c7b-a32c-a4ab87b19cf1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:30.144456 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5355081f-af92-4c7b-a32c-a4ab87b19cf1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:30.144456 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5355081f-af92-4c7b-a32c-a4ab87b19cf1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:30.144456 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5355081f-af92-4c7b-a32c-a4ab87b19cf1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:30.334038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5355081f-af92-4c7b-a32c-a4ab87b19cf1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:30.346875 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5355081f-af92-4c7b-a32c-a4ab87b19cf1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1265 microversion: 2.1 time: 0.225987 Jun 16 18:23:30.347856 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 608/1216] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:30 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:23:30.365524 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2db648b8-9b25-49a3-8bd2-a63b81549388 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-6500080"}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:23:30.366445 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2db648b8-9b25-49a3-8bd2-a63b81549388 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:30.373663 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2db648b8-9b25-49a3-8bd2-a63b81549388 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:30.374104 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2db648b8-9b25-49a3-8bd2-a63b81549388 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:30.374882 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2db648b8-9b25-49a3-8bd2-a63b81549388 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:30.375309 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2db648b8-9b25-49a3-8bd2-a63b81549388 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:30.534220 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.network.security_group_api [None req-2db648b8-9b25-49a3-8bd2-a63b81549388 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Adding security group c4def286-89d9-4203-8ee9-fa1e79bd1d54 to port 68704890-0b9c-4d29-b937-474b57bb62e2 Jun 16 18:23:31.041849 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2db648b8-9b25-49a3-8bd2-a63b81549388 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "POST /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/action" status: 202 len: 0 microversion: 2.1 time: 0.680809 Jun 16 18:23:31.060296 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 609/1217] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:23:30 2022] POST /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/action => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:23:31.060510 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-d7292da5-52f1-4b1f-8a5b-2af32b83e747 req-bf8dd292-9202-4d88-9e37-6583b06ae413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13282fd3-f81a-41ec-a714-aca0bbee3325", "tag": "68704890-0b9c-4d29-b937-474b57bb62e2"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:23:31.060666 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8863de52-975f-4a37-b430-6b4c1646fc4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:31.060666 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8863de52-975f-4a37-b430-6b4c1646fc4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:31.063449 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8863de52-975f-4a37-b430-6b4c1646fc4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:31.064906 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8863de52-975f-4a37-b430-6b4c1646fc4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:31.065921 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8863de52-975f-4a37-b430-6b4c1646fc4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:31.066734 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8863de52-975f-4a37-b430-6b4c1646fc4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:31.077852 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-d7292da5-52f1-4b1f-8a5b-2af32b83e747 req-bf8dd292-9202-4d88-9e37-6583b06ae413 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:31.078375 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-d7292da5-52f1-4b1f-8a5b-2af32b83e747 req-bf8dd292-9202-4d88-9e37-6583b06ae413 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:31.107178 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-d7292da5-52f1-4b1f-8a5b-2af32b83e747 req-bf8dd292-9202-4d88-9e37-6583b06ae413 service nova] Creating event network-changed:68704890-0b9c-4d29-b937-474b57bb62e2 for instance 13282fd3-f81a-41ec-a714-aca0bbee3325 on hv-cinder-83754 Jun 16 18:23:31.118996 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-d7292da5-52f1-4b1f-8a5b-2af32b83e747 req-bf8dd292-9202-4d88-9e37-6583b06ae413 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071428 Jun 16 18:23:31.123623 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 609/1218] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:23:31.274757 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8863de52-975f-4a37-b430-6b4c1646fc4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:31.284723 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8863de52-975f-4a37-b430-6b4c1646fc4b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1756 microversion: 2.1 time: 0.233861 Jun 16 18:23:31.285034 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 610/1219] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:31 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1756 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:31.369519 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-cc03cea6-278c-49a2-8fc4-133962c5fd38 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:31.377960 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-cc03cea6-278c-49a2-8fc4-133962c5fd38 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:31.377960 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cc03cea6-278c-49a2-8fc4-133962c5fd38 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:31.378322 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cc03cea6-278c-49a2-8fc4-133962c5fd38 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:31.378941 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cc03cea6-278c-49a2-8fc4-133962c5fd38 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:31.379391 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cc03cea6-278c-49a2-8fc4-133962c5fd38 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:31.554610 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-cc03cea6-278c-49a2-8fc4-133962c5fd38 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:31.575749 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-cc03cea6-278c-49a2-8fc4-133962c5fd38 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1265 microversion: 2.1 time: 0.199997 Jun 16 18:23:31.575749 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 610/1220] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:31 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:32.581682 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-b6b985cb-c793-485d-8846-0fb0c9381dac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:32.582324 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-b6b985cb-c793-485d-8846-0fb0c9381dac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:32.585112 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=2 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:23:32.590549 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b6b985cb-c793-485d-8846-0fb0c9381dac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:32.590998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b6b985cb-c793-485d-8846-0fb0c9381dac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:32.591809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b6b985cb-c793-485d-8846-0fb0c9381dac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:32.592246 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-b6b985cb-c793-485d-8846-0fb0c9381dac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:32.734029 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-b6b985cb-c793-485d-8846-0fb0c9381dac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:32.741829 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-b6b985cb-c793-485d-8846-0fb0c9381dac tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1265 microversion: 2.1 time: 0.164047 Jun 16 18:23:32.742388 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 611/1221] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:32 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:33.760070 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-695296f0-3b9a-4156-b5b8-9fa51eb13d7a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:33.761159 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-695296f0-3b9a-4156-b5b8-9fa51eb13d7a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:33.768003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-695296f0-3b9a-4156-b5b8-9fa51eb13d7a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:33.768453 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-695296f0-3b9a-4156-b5b8-9fa51eb13d7a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:33.769433 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-695296f0-3b9a-4156-b5b8-9fa51eb13d7a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:33.769962 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-695296f0-3b9a-4156-b5b8-9fa51eb13d7a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:33.919507 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-695296f0-3b9a-4156-b5b8-9fa51eb13d7a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:33.929715 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-695296f0-3b9a-4156-b5b8-9fa51eb13d7a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1265 microversion: 2.1 time: 0.173609 Jun 16 18:23:33.930314 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 611/1222] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:33 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:34.951542 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-372183ad-5773-468f-82ff-c128d2750f28 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:34.952165 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-372183ad-5773-468f-82ff-c128d2750f28 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:34.954535 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell0:SELECT=10 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:23:34.959748 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-372183ad-5773-468f-82ff-c128d2750f28 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:34.960201 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-372183ad-5773-468f-82ff-c128d2750f28 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:34.961192 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-372183ad-5773-468f-82ff-c128d2750f28 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:34.961386 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-372183ad-5773-468f-82ff-c128d2750f28 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:35.118414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-372183ad-5773-468f-82ff-c128d2750f28 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:35.126755 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-372183ad-5773-468f-82ff-c128d2750f28 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1265 microversion: 2.1 time: 0.179270 Jun 16 18:23:35.127440 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 612/1223] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:34 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:36.144315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-1a4c45ce-f9bf-4683-8874-a20a3e0fd76c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:36.145112 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-1a4c45ce-f9bf-4683-8874-a20a3e0fd76c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:36.152039 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a4c45ce-f9bf-4683-8874-a20a3e0fd76c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:36.152484 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a4c45ce-f9bf-4683-8874-a20a3e0fd76c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:36.153263 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a4c45ce-f9bf-4683-8874-a20a3e0fd76c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:36.153693 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-1a4c45ce-f9bf-4683-8874-a20a3e0fd76c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:36.315451 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-1a4c45ce-f9bf-4683-8874-a20a3e0fd76c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:36.325855 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-1a4c45ce-f9bf-4683-8874-a20a3e0fd76c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1265 microversion: 2.1 time: 0.185084 Jun 16 18:23:36.326869 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 612/1224] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:36 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:23:37.347698 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-068de101-3075-4995-81d0-08a3a533bfb6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:37.348852 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-068de101-3075-4995-81d0-08a3a533bfb6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:37.357539 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-068de101-3075-4995-81d0-08a3a533bfb6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:37.357986 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-068de101-3075-4995-81d0-08a3a533bfb6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:37.358765 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-068de101-3075-4995-81d0-08a3a533bfb6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:37.359199 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-068de101-3075-4995-81d0-08a3a533bfb6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:37.518930 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-068de101-3075-4995-81d0-08a3a533bfb6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:37.527477 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-068de101-3075-4995-81d0-08a3a533bfb6 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1265 microversion: 2.1 time: 0.186456 Jun 16 18:23:37.528003 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 613/1225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:37 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:38.546026 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-741d8110-b290-4a65-9dc7-4ccfe045e433 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:38.546694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-741d8110-b290-4a65-9dc7-4ccfe045e433 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:38.553728 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-741d8110-b290-4a65-9dc7-4ccfe045e433 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:38.554223 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-741d8110-b290-4a65-9dc7-4ccfe045e433 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:38.555039 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-741d8110-b290-4a65-9dc7-4ccfe045e433 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:38.555606 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-741d8110-b290-4a65-9dc7-4ccfe045e433 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:38.699611 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-741d8110-b290-4a65-9dc7-4ccfe045e433 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:38.708132 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-741d8110-b290-4a65-9dc7-4ccfe045e433 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1265 microversion: 2.1 time: 0.166301 Jun 16 18:23:38.708709 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 613/1226] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:38 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:23:39.729330 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1b58c81d-7b9a-4c2a-9325-2c3116dd9bc2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:39.730476 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1b58c81d-7b9a-4c2a-9325-2c3116dd9bc2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:39.741590 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1b58c81d-7b9a-4c2a-9325-2c3116dd9bc2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:39.742364 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1b58c81d-7b9a-4c2a-9325-2c3116dd9bc2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:39.743649 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1b58c81d-7b9a-4c2a-9325-2c3116dd9bc2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:39.744315 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1b58c81d-7b9a-4c2a-9325-2c3116dd9bc2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:39.921226 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1b58c81d-7b9a-4c2a-9325-2c3116dd9bc2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:39.930452 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1b58c81d-7b9a-4c2a-9325-2c3116dd9bc2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1265 microversion: 2.1 time: 0.208104 Jun 16 18:23:39.931315 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 614/1227] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:39 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:40.962932 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-cf5c95ad-7768-492d-9b3e-c1dedcbd8351 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:40.963750 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-cf5c95ad-7768-492d-9b3e-c1dedcbd8351 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:40.973862 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cf5c95ad-7768-492d-9b3e-c1dedcbd8351 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:40.974676 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cf5c95ad-7768-492d-9b3e-c1dedcbd8351 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:40.976019 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cf5c95ad-7768-492d-9b3e-c1dedcbd8351 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:40.976771 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-cf5c95ad-7768-492d-9b3e-c1dedcbd8351 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:41.152057 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-cf5c95ad-7768-492d-9b3e-c1dedcbd8351 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:41.160101 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-cf5c95ad-7768-492d-9b3e-c1dedcbd8351 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1265 microversion: 2.1 time: 0.205737 Jun 16 18:23:41.160609 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 614/1228] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:40 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:41.191571 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-971703ab-fd3f-4b26-969c-ab04e9bfde7a req-0eaa8752-0344-4d77-b5b1-8369baaca1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ee60a0-0ed0-4dd7-95e5-485558986d52", "name": "network-vif-plugged", "status": "completed", "tag": "79320d68-8728-4505-8872-70bd2eac8f26"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:23:41.206590 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-971703ab-fd3f-4b26-969c-ab04e9bfde7a req-0eaa8752-0344-4d77-b5b1-8369baaca1f0 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:41.207341 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-971703ab-fd3f-4b26-969c-ab04e9bfde7a req-0eaa8752-0344-4d77-b5b1-8369baaca1f0 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:41.221805 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-971703ab-fd3f-4b26-969c-ab04e9bfde7a req-0eaa8752-0344-4d77-b5b1-8369baaca1f0 service nova] Creating event network-vif-plugged:79320d68-8728-4505-8872-70bd2eac8f26 for instance 17ee60a0-0ed0-4dd7-95e5-485558986d52 on hv-cinder-83754 Jun 16 18:23:41.227637 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-971703ab-fd3f-4b26-969c-ab04e9bfde7a req-0eaa8752-0344-4d77-b5b1-8369baaca1f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040177 Jun 16 18:23:41.228292 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 615/1229] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:23:42.178702 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-72a48d23-cb5d-4dfb-b551-bbb08e904420 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:42.179343 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-72a48d23-cb5d-4dfb-b551-bbb08e904420 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:42.186432 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-72a48d23-cb5d-4dfb-b551-bbb08e904420 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:42.186884 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-72a48d23-cb5d-4dfb-b551-bbb08e904420 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:42.187675 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-72a48d23-cb5d-4dfb-b551-bbb08e904420 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:42.188105 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-72a48d23-cb5d-4dfb-b551-bbb08e904420 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:42.336766 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-72a48d23-cb5d-4dfb-b551-bbb08e904420 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:42.345273 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-72a48d23-cb5d-4dfb-b551-bbb08e904420 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1265 microversion: 2.1 time: 0.170937 Jun 16 18:23:42.345847 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 615/1230] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:42 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:43.367334 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6ebea79a-f67a-4265-9782-f6c83e18ec35 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:43.368080 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6ebea79a-f67a-4265-9782-f6c83e18ec35 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:43.378232 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6ebea79a-f67a-4265-9782-f6c83e18ec35 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:43.378972 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6ebea79a-f67a-4265-9782-f6c83e18ec35 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:43.380297 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6ebea79a-f67a-4265-9782-f6c83e18ec35 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:43.381057 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6ebea79a-f67a-4265-9782-f6c83e18ec35 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:43.569289 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-6ebea79a-f67a-4265-9782-f6c83e18ec35 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:43.578048 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6ebea79a-f67a-4265-9782-f6c83e18ec35 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1265 microversion: 2.1 time: 0.217718 Jun 16 18:23:43.578621 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 616/1231] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:43 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:44.595314 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-6ea24e58-4397-4252-8220-a040a0dce4e2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:44.595977 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-6ea24e58-4397-4252-8220-a040a0dce4e2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:44.602665 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6ea24e58-4397-4252-8220-a040a0dce4e2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:44.603114 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6ea24e58-4397-4252-8220-a040a0dce4e2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:44.603906 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6ea24e58-4397-4252-8220-a040a0dce4e2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:44.605144 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-6ea24e58-4397-4252-8220-a040a0dce4e2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:44.754927 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-6ea24e58-4397-4252-8220-a040a0dce4e2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:44.763877 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-6ea24e58-4397-4252-8220-a040a0dce4e2 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1453 microversion: 2.1 time: 0.172443 Jun 16 18:23:44.764431 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 616/1232] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:44 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:44.782920 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-74fe4140-8bbb-4181-bf51-c52c809b84de tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:23:44.783586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-74fe4140-8bbb-4181-bf51-c52c809b84de tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:23:44.790185 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-74fe4140-8bbb-4181-bf51-c52c809b84de tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:44.790621 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-74fe4140-8bbb-4181-bf51-c52c809b84de tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:44.791431 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-74fe4140-8bbb-4181-bf51-c52c809b84de tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:44.792069 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-74fe4140-8bbb-4181-bf51-c52c809b84de tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:44.959292 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-74fe4140-8bbb-4181-bf51-c52c809b84de tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:23:44.968161 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-74fe4140-8bbb-4181-bf51-c52c809b84de tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1453 microversion: 2.1 time: 0.189127 Jun 16 18:23:44.968739 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 617/1233] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:23:44 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:23:47.396427 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-b4473982-0f3f-4313-9dc4-5f372a2e0955 req-4f8341c6-f05f-402b-b2e3-1689e473d007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ee60a0-0ed0-4dd7-95e5-485558986d52", "tag": "79320d68-8728-4505-8872-70bd2eac8f26"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:23:47.406492 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-b4473982-0f3f-4313-9dc4-5f372a2e0955 req-4f8341c6-f05f-402b-b2e3-1689e473d007 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:23:47.406940 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-b4473982-0f3f-4313-9dc4-5f372a2e0955 req-4f8341c6-f05f-402b-b2e3-1689e473d007 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:23:47.419936 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-b4473982-0f3f-4313-9dc4-5f372a2e0955 req-4f8341c6-f05f-402b-b2e3-1689e473d007 service nova] Creating event network-changed:79320d68-8728-4505-8872-70bd2eac8f26 for instance 17ee60a0-0ed0-4dd7-95e5-485558986d52 on hv-cinder-83754 Jun 16 18:23:47.428349 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-b4473982-0f3f-4313-9dc4-5f372a2e0955 req-4f8341c6-f05f-402b-b2e3-1689e473d007 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034807 Jun 16 18:23:47.429903 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 617/1234] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:24:19.431725 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-37624d91-2527-4e95-8ca0-c5f97f0af6c4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:24:19.433461 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-37624d91-2527-4e95-8ca0-c5f97f0af6c4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:19.436377 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:24:19.437436 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=60 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:24:19.446209 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-37624d91-2527-4e95-8ca0-c5f97f0af6c4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:19.446666 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-37624d91-2527-4e95-8ca0-c5f97f0af6c4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:19.447494 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-37624d91-2527-4e95-8ca0-c5f97f0af6c4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:19.447956 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-37624d91-2527-4e95-8ca0-c5f97f0af6c4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:19.941630 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-37624d91-2527-4e95-8ca0-c5f97f0af6c4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "POST /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/action" status: 202 len: 0 microversion: 2.1 time: 0.513803 Jun 16 18:24:19.942649 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 618/1235] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:24:19 2022] POST /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:24:19.949842 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=28 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:24:19.950824 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=76 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:24:19.955042 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-a8475773-764c-45f5-bd27-3ea9d6ef7a01 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:24:19.955789 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-a8475773-764c-45f5-bd27-3ea9d6ef7a01 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:19.962868 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a8475773-764c-45f5-bd27-3ea9d6ef7a01 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:19.963320 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a8475773-764c-45f5-bd27-3ea9d6ef7a01 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:19.964812 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a8475773-764c-45f5-bd27-3ea9d6ef7a01 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:19.965237 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-a8475773-764c-45f5-bd27-3ea9d6ef7a01 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:20.114515 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-a8475773-764c-45f5-bd27-3ea9d6ef7a01 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:24:20.122633 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-a8475773-764c-45f5-bd27-3ea9d6ef7a01 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1748 microversion: 2.1 time: 0.175487 Jun 16 18:24:20.123209 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 618/1236] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:24:19 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:24:21.140903 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-323ae248-4a0c-4e8d-978c-264137c335b4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:24:21.141607 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-323ae248-4a0c-4e8d-978c-264137c335b4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:21.148896 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-323ae248-4a0c-4e8d-978c-264137c335b4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:21.149402 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-323ae248-4a0c-4e8d-978c-264137c335b4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:21.150167 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-323ae248-4a0c-4e8d-978c-264137c335b4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:21.150604 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-323ae248-4a0c-4e8d-978c-264137c335b4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:21.311785 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-323ae248-4a0c-4e8d-978c-264137c335b4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:24:21.315020 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-323ae248-4a0c-4e8d-978c-264137c335b4 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1753 microversion: 2.1 time: 0.178438 Jun 16 18:24:21.315670 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 619/1237] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:24:21 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:24:22.334847 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f94417a0-d6d5-4170-b027-dfad7395c3bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:24:22.335511 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f94417a0-d6d5-4170-b027-dfad7395c3bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:22.342928 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f94417a0-d6d5-4170-b027-dfad7395c3bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:22.343400 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f94417a0-d6d5-4170-b027-dfad7395c3bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:22.344151 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f94417a0-d6d5-4170-b027-dfad7395c3bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:22.344582 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f94417a0-d6d5-4170-b027-dfad7395c3bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:22.493963 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f94417a0-d6d5-4170-b027-dfad7395c3bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:24:22.503126 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f94417a0-d6d5-4170-b027-dfad7395c3bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1753 microversion: 2.1 time: 0.172740 Jun 16 18:24:22.503745 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 619/1238] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:24:22 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:24:23.520422 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-77c7f859-c6ff-42ee-b05e-b83cbd31f48b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:24:23.521455 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-77c7f859-c6ff-42ee-b05e-b83cbd31f48b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:23.528514 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-77c7f859-c6ff-42ee-b05e-b83cbd31f48b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:23.528961 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-77c7f859-c6ff-42ee-b05e-b83cbd31f48b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:23.529737 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-77c7f859-c6ff-42ee-b05e-b83cbd31f48b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:23.530168 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-77c7f859-c6ff-42ee-b05e-b83cbd31f48b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:23.960989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-77c7f859-c6ff-42ee-b05e-b83cbd31f48b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:24:23.970598 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-77c7f859-c6ff-42ee-b05e-b83cbd31f48b tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1753 microversion: 2.1 time: 0.454517 Jun 16 18:24:23.971175 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 620/1239] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:24:23 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1753 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:24:24.989088 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-abf46841-cf7c-4148-99f1-f31539900a57 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:24:24.989877 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-abf46841-cf7c-4148-99f1-f31539900a57 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:24.997454 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-abf46841-cf7c-4148-99f1-f31539900a57 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:24.997899 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-abf46841-cf7c-4148-99f1-f31539900a57 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:24.998656 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-abf46841-cf7c-4148-99f1-f31539900a57 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:24.999082 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-abf46841-cf7c-4148-99f1-f31539900a57 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:25.154773 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-abf46841-cf7c-4148-99f1-f31539900a57 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:24:25.163038 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-abf46841-cf7c-4148-99f1-f31539900a57 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1753 microversion: 2.1 time: 0.177814 Jun 16 18:24:25.163646 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 620/1240] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:24:24 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:24:26.181078 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ddefa8d6-d49c-49b8-bf53-b61572f261bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:24:26.181684 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ddefa8d6-d49c-49b8-bf53-b61572f261bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:26.189125 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ddefa8d6-d49c-49b8-bf53-b61572f261bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:26.189562 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ddefa8d6-d49c-49b8-bf53-b61572f261bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:26.190317 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ddefa8d6-d49c-49b8-bf53-b61572f261bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:26.190745 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ddefa8d6-d49c-49b8-bf53-b61572f261bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:26.354067 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ddefa8d6-d49c-49b8-bf53-b61572f261bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:24:26.362418 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ddefa8d6-d49c-49b8-bf53-b61572f261bf tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1753 microversion: 2.1 time: 0.185539 Jun 16 18:24:26.362987 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 621/1241] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:24:26 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:24:27.380270 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2b77e880-ba3d-4abf-b474-f4dbdf4e0eb0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:24:27.381010 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2b77e880-ba3d-4abf-b474-f4dbdf4e0eb0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:27.387672 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2b77e880-ba3d-4abf-b474-f4dbdf4e0eb0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:27.388124 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2b77e880-ba3d-4abf-b474-f4dbdf4e0eb0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:27.388893 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2b77e880-ba3d-4abf-b474-f4dbdf4e0eb0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:27.389332 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2b77e880-ba3d-4abf-b474-f4dbdf4e0eb0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:27.541693 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-2b77e880-ba3d-4abf-b474-f4dbdf4e0eb0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:24:27.551006 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2b77e880-ba3d-4abf-b474-f4dbdf4e0eb0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1753 microversion: 2.1 time: 0.174601 Jun 16 18:24:27.551635 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 621/1242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:24:27 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:24:28.568676 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-29d44097-b9f5-4253-97d2-4a3ba1d56c25 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:24:28.569271 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-29d44097-b9f5-4253-97d2-4a3ba1d56c25 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:28.577059 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-29d44097-b9f5-4253-97d2-4a3ba1d56c25 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:28.577494 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-29d44097-b9f5-4253-97d2-4a3ba1d56c25 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:28.578250 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-29d44097-b9f5-4253-97d2-4a3ba1d56c25 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:28.578672 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-29d44097-b9f5-4253-97d2-4a3ba1d56c25 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:28.742224 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-29d44097-b9f5-4253-97d2-4a3ba1d56c25 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:24:28.750378 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-29d44097-b9f5-4253-97d2-4a3ba1d56c25 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1753 microversion: 2.1 time: 0.185645 Jun 16 18:24:28.750944 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 622/1243] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:24:28 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:24:29.767848 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f32b9ad2-185c-4084-99ad-e6b26cacfc83 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:24:29.768453 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f32b9ad2-185c-4084-99ad-e6b26cacfc83 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:29.775017 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f32b9ad2-185c-4084-99ad-e6b26cacfc83 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:29.775524 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f32b9ad2-185c-4084-99ad-e6b26cacfc83 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:29.776447 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f32b9ad2-185c-4084-99ad-e6b26cacfc83 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:29.776938 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f32b9ad2-185c-4084-99ad-e6b26cacfc83 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:29.937912 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f32b9ad2-185c-4084-99ad-e6b26cacfc83 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:24:29.945991 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f32b9ad2-185c-4084-99ad-e6b26cacfc83 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1753 microversion: 2.1 time: 0.182090 Jun 16 18:24:29.946712 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 622/1244] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:24:29 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:24:30.967337 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2108619d-6a78-4d5e-9abd-c9cc4b9ac227 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:24:30.967963 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2108619d-6a78-4d5e-9abd-c9cc4b9ac227 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:30.974737 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2108619d-6a78-4d5e-9abd-c9cc4b9ac227 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:30.975174 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2108619d-6a78-4d5e-9abd-c9cc4b9ac227 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:30.975954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2108619d-6a78-4d5e-9abd-c9cc4b9ac227 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:30.976378 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2108619d-6a78-4d5e-9abd-c9cc4b9ac227 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:31.129047 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-2108619d-6a78-4d5e-9abd-c9cc4b9ac227 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:24:31.138158 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2108619d-6a78-4d5e-9abd-c9cc4b9ac227 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1753 microversion: 2.1 time: 0.175117 Jun 16 18:24:31.138725 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 623/1245] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:24:30 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:24:32.155808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-5ea9adbc-03dd-44da-91a8-dbb4d3e76d74 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:24:32.156434 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-5ea9adbc-03dd-44da-91a8-dbb4d3e76d74 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:32.163568 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5ea9adbc-03dd-44da-91a8-dbb4d3e76d74 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:32.164014 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5ea9adbc-03dd-44da-91a8-dbb4d3e76d74 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:32.164792 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5ea9adbc-03dd-44da-91a8-dbb4d3e76d74 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:32.165224 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-5ea9adbc-03dd-44da-91a8-dbb4d3e76d74 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:32.320729 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-5ea9adbc-03dd-44da-91a8-dbb4d3e76d74 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:24:32.329747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-5ea9adbc-03dd-44da-91a8-dbb4d3e76d74 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1753 microversion: 2.1 time: 0.178599 Jun 16 18:24:32.330326 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 623/1246] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:24:32 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:24:33.348716 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-1e51bcf9-617c-46d5-b53c-dafe559bb05a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:24:33.349339 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-1e51bcf9-617c-46d5-b53c-dafe559bb05a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:24:33.357045 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1e51bcf9-617c-46d5-b53c-dafe559bb05a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:33.357492 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1e51bcf9-617c-46d5-b53c-dafe559bb05a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:33.358273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1e51bcf9-617c-46d5-b53c-dafe559bb05a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:24:33.358706 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-1e51bcf9-617c-46d5-b53c-dafe559bb05a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:24:33.524647 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-1e51bcf9-617c-46d5-b53c-dafe559bb05a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:24:33.533905 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-1e51bcf9-617c-46d5-b53c-dafe559bb05a tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1756 microversion: 2.1 time: 0.189203 Jun 16 18:24:33.534481 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 624/1247] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:24:33 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:25:08.140724 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:25:08.141763 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Thu Jun 16 18:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:25:28.889834 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-824cff1e-09a1-407f-9fd9-8fa27ecbafbc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-6500080"}} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:25:28.890473 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-824cff1e-09a1-407f-9fd9-8fa27ecbafbc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:28.892562 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_api:SELECT=12 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:25:28.893199 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=36 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:25:28.897962 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-824cff1e-09a1-407f-9fd9-8fa27ecbafbc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:28.898402 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-824cff1e-09a1-407f-9fd9-8fa27ecbafbc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:28.899768 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-824cff1e-09a1-407f-9fd9-8fa27ecbafbc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:28.900770 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-824cff1e-09a1-407f-9fd9-8fa27ecbafbc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:29.036236 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.network.security_group_api [None req-824cff1e-09a1-407f-9fd9-8fa27ecbafbc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Removing security group c4def286-89d9-4203-8ee9-fa1e79bd1d54 from port 68704890-0b9c-4d29-b937-474b57bb62e2 Jun 16 18:25:29.631409 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-824cff1e-09a1-407f-9fd9-8fa27ecbafbc tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "POST /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/action" status: 202 len: 0 microversion: 2.1 time: 0.745447 Jun 16 18:25:29.636572 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 624/1248] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Jun 16 18:25:28 2022] POST /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/action => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:25:29.640501 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-2f660ad0-972c-482f-82c7-4a7214fbd94b req-9ced763e-6573-4ec8-9115-ba7ba6e62c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13282fd3-f81a-41ec-a714-aca0bbee3325", "tag": "68704890-0b9c-4d29-b937-474b57bb62e2"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:25:29.645545 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_api:SELECT=14 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:25:29.654463 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG dbcounter [-] [118161] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:25:29.661458 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-2f660ad0-972c-482f-82c7-4a7214fbd94b req-9ced763e-6573-4ec8-9115-ba7ba6e62c4d service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:29.661899 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-2f660ad0-972c-482f-82c7-4a7214fbd94b req-9ced763e-6573-4ec8-9115-ba7ba6e62c4d service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:29.690286 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-2f660ad0-972c-482f-82c7-4a7214fbd94b req-9ced763e-6573-4ec8-9115-ba7ba6e62c4d service nova] Creating event network-changed:68704890-0b9c-4d29-b937-474b57bb62e2 for instance 13282fd3-f81a-41ec-a714-aca0bbee3325 on hv-cinder-83754 Jun 16 18:25:29.703527 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-2f660ad0-972c-482f-82c7-4a7214fbd94b req-9ced763e-6573-4ec8-9115-ba7ba6e62c4d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063908 Jun 16 18:25:29.704808 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 625/1249] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:25:31.433544 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-bca8d001-3781-4589-a440-7046ca78edf1 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:31.434133 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-bca8d001-3781-4589-a440-7046ca78edf1 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:31.440636 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bca8d001-3781-4589-a440-7046ca78edf1 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:31.441106 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bca8d001-3781-4589-a440-7046ca78edf1 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:31.441864 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bca8d001-3781-4589-a440-7046ca78edf1 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:31.442429 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-bca8d001-3781-4589-a440-7046ca78edf1 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:31.546384 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-bca8d001-3781-4589-a440-7046ca78edf1 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lazy-loading 'services' on Instance uuid 13282fd3-f81a-41ec-a714-aca0bbee3325 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:25:31.717526 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-6c08ddad-79de-4bff-86a3-ce4e1a830a2c req-6f4b3796-573d-4b98-b550-4b19e2778c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13282fd3-f81a-41ec-a714-aca0bbee3325", "tag": "68704890-0b9c-4d29-b937-474b57bb62e2"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:25:31.729569 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-6c08ddad-79de-4bff-86a3-ce4e1a830a2c req-6f4b3796-573d-4b98-b550-4b19e2778c29 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:31.730113 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-6c08ddad-79de-4bff-86a3-ce4e1a830a2c req-6f4b3796-573d-4b98-b550-4b19e2778c29 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:31.742333 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-6c08ddad-79de-4bff-86a3-ce4e1a830a2c req-6f4b3796-573d-4b98-b550-4b19e2778c29 service nova] Creating event network-changed:68704890-0b9c-4d29-b937-474b57bb62e2 for instance 13282fd3-f81a-41ec-a714-aca0bbee3325 on hv-cinder-83754 Jun 16 18:25:31.748251 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-6c08ddad-79de-4bff-86a3-ce4e1a830a2c req-6f4b3796-573d-4b98-b550-4b19e2778c29 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036364 Jun 16 18:25:31.748654 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 626/1250] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:25:31.873623 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-bca8d001-3781-4589-a440-7046ca78edf1 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments/b44834e5-3175-43f8-bc5a-f4a24a1e065d" status: 202 len: 0 microversion: 2.1 time: 0.444880 Jun 16 18:25:31.878209 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 625/1251] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jun 16 18:25:31 2022] DELETE /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments/b44834e5-3175-43f8-bc5a-f4a24a1e065d => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:25:31.894565 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-73c406a7-17a2-4f48-b118-c988aefdab10 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:31.897934 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-73c406a7-17a2-4f48-b118-c988aefdab10 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:31.908896 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-73c406a7-17a2-4f48-b118-c988aefdab10 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:31.909674 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-73c406a7-17a2-4f48-b118-c988aefdab10 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:31.910729 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-73c406a7-17a2-4f48-b118-c988aefdab10 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:31.911285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-73c406a7-17a2-4f48-b118-c988aefdab10 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:31.954045 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-73c406a7-17a2-4f48-b118-c988aefdab10 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063789 Jun 16 18:25:31.954630 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 627/1252] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:25:31 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:25:32.968015 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-3ea67209-857b-4cdb-98ec-7d5c227a6eab tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:32.969046 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-3ea67209-857b-4cdb-98ec-7d5c227a6eab tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:32.975395 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3ea67209-857b-4cdb-98ec-7d5c227a6eab tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:32.975910 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3ea67209-857b-4cdb-98ec-7d5c227a6eab tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:32.976681 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3ea67209-857b-4cdb-98ec-7d5c227a6eab tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:32.977619 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-3ea67209-857b-4cdb-98ec-7d5c227a6eab tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:33.007125 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-3ea67209-857b-4cdb-98ec-7d5c227a6eab tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044718 Jun 16 18:25:33.007764 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 626/1253] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:25:32 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:25:34.019397 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-f10397f0-4b9d-4057-aa98-af646d0a21b6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:34.020335 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-f10397f0-4b9d-4057-aa98-af646d0a21b6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:34.027686 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f10397f0-4b9d-4057-aa98-af646d0a21b6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:34.028143 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f10397f0-4b9d-4057-aa98-af646d0a21b6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:34.028921 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f10397f0-4b9d-4057-aa98-af646d0a21b6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:34.029356 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-f10397f0-4b9d-4057-aa98-af646d0a21b6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:34.058282 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-f10397f0-4b9d-4057-aa98-af646d0a21b6 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043180 Jun 16 18:25:34.064469 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 628/1254] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Jun 16 18:25:34 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:25:34.068838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4cbcc655-64fc-4b8f-b8e6-40644c812244 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:34.069323 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-4cbcc655-64fc-4b8f-b8e6-40644c812244 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:34.076197 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4cbcc655-64fc-4b8f-b8e6-40644c812244 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:34.076635 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4cbcc655-64fc-4b8f-b8e6-40644c812244 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:34.077384 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4cbcc655-64fc-4b8f-b8e6-40644c812244 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:34.077810 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-4cbcc655-64fc-4b8f-b8e6-40644c812244 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:34.153831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-4cbcc655-64fc-4b8f-b8e6-40644c812244 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] HTTP exception thrown: Instance 13282fd3-f81a-41ec-a714-aca0bbee3325 is not attached to volume b44834e5-3175-43f8-bc5a-f4a24a1e065d Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4cbcc655-64fc-4b8f-b8e6-40644c812244 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Request method failure captured: Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: DELETE /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments/b44834e5-3175-43f8-bc5a-f4a24a1e065d HTTP/1.1 Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3TZPgE99esImYGle0X4swDwG61DW1-jIUJLTm4_DP_y9v8k4EzBUfBTb2sngJ3Q0NOxmBQMvpJK2AxAQ6axtS5BMntr4obiUPVGcDTwokc4KflWFze0-1q6GqHvHPVdVmzMl0Y-VSM2GwIeckV3R6wTxtcdozwQ-UwkdIU8mMKLhss Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: 60fd87cc7cb24ee0a0006089d4b13084 Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-TestMinimumBasicScenario-707270777 Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:25:34.156252 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:25:34.158128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_60fd87cc7cb24ee0a0006089d4b13084"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/60fd87cc7cb24ee0a0006089d4b13084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/60fd87cc7cb24ee0a0006089d4b13084"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/60fd87cc7cb24ee0a0006089d4b13084"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:25:34.158128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-TestMinimumBasicScenario-707270777 Jun 16 18:25:34.158128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: 60fd87cc7cb24ee0a0006089d4b13084 Jun 16 18:25:34.158128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-TestMinimumBasicScenario-707270777 Jun 16 18:25:34.158128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-TestMinimumBasicScenario-707270777-project Jun 16 18:25:34.158128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:25:34.158128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:25:34.158128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: e3f73a99241e449bbee5e0a28878e80c Jun 16 18:25:34.158128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-TestMinimumBasicScenario-707270777-project Jun 16 18:25:34.158128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:25:34.158128 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 13282fd3-f81a-41ec-a714-aca0bbee3325 is not attached to volume b44834e5-3175-43f8-bc5a-f4a24a1e065d Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'server_id': '13282fd3-f81a-41ec-a714-aca0bbee3325', 'id': 'b44834e5-3175-43f8-bc5a-f4a24a1e065d'} Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b44834e5-3175-43f8-bc5a-f4a24a1e065d. Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:25:34.159099 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13282fd3-f81a-41ec-a714-aca0bbee3325 is not attached to volume b44834e5-3175-43f8-bc5a-f4a24a1e065d Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13282fd3-f81a-41ec-a714-aca0bbee3325 is not attached to volume b44834e5-3175-43f8-bc5a-f4a24a1e065d Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:34.167093 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-4cbcc655-64fc-4b8f-b8e6-40644c812244 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Returning 404 to user: Instance 13282fd3-f81a-41ec-a714-aca0bbee3325 is not attached to volume b44834e5-3175-43f8-bc5a-f4a24a1e065d {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:25:34.169149 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-4cbcc655-64fc-4b8f-b8e6-40644c812244 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments/b44834e5-3175-43f8-bc5a-f4a24a1e065d" status: 404 len: 154 microversion: 2.1 time: 0.092949 Jun 16 18:25:34.169149 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 627/1255] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Jun 16 18:25:34 2022] DELETE /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325/os-volume_attachments/b44834e5-3175-43f8-bc5a-f4a24a1e065d => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:25:35.594879 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-48ae061a-4a61-4e6a-8074-ee5d0ba59109 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:35.595550 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-48ae061a-4a61-4e6a-8074-ee5d0ba59109 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:35.603687 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-48ae061a-4a61-4e6a-8074-ee5d0ba59109 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:35.604133 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-48ae061a-4a61-4e6a-8074-ee5d0ba59109 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:35.604917 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-48ae061a-4a61-4e6a-8074-ee5d0ba59109 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:35.605360 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-48ae061a-4a61-4e6a-8074-ee5d0ba59109 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:35.631991 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-48ae061a-4a61-4e6a-8074-ee5d0ba59109 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Going to try to terminate instance {{(pid=118161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:25:36.075853 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-48ae061a-4a61-4e6a-8074-ee5d0ba59109 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "DELETE /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 204 len: 0 microversion: 2.1 time: 0.484523 Jun 16 18:25:36.076586 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 629/1256] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:25:35 2022] DELETE /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:25:36.085002 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0bf8f824-d2dc-4e51-90d8-6c87e716015f tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:36.085538 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-0bf8f824-d2dc-4e51-90d8-6c87e716015f tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:36.093364 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0bf8f824-d2dc-4e51-90d8-6c87e716015f tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:36.094023 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0bf8f824-d2dc-4e51-90d8-6c87e716015f tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:36.095005 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0bf8f824-d2dc-4e51-90d8-6c87e716015f tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:36.095599 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-0bf8f824-d2dc-4e51-90d8-6c87e716015f tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:36.245694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-0bf8f824-d2dc-4e51-90d8-6c87e716015f tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:36.253629 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0bf8f824-d2dc-4e51-90d8-6c87e716015f tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1553 microversion: 2.1 time: 0.172753 Jun 16 18:25:36.254223 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 628/1257] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:36 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:25:37.272471 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-4476a7ba-41a4-4a31-8a66-4b0ced5164aa tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:37.273180 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-4476a7ba-41a4-4a31-8a66-4b0ced5164aa tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:37.282509 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4476a7ba-41a4-4a31-8a66-4b0ced5164aa tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:37.282509 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4476a7ba-41a4-4a31-8a66-4b0ced5164aa tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:37.282928 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4476a7ba-41a4-4a31-8a66-4b0ced5164aa tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:37.283169 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-4476a7ba-41a4-4a31-8a66-4b0ced5164aa tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:37.512560 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-4476a7ba-41a4-4a31-8a66-4b0ced5164aa tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:37.521070 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-4476a7ba-41a4-4a31-8a66-4b0ced5164aa tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1553 microversion: 2.1 time: 0.252927 Jun 16 18:25:37.521648 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 630/1258] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:37 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1553 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:25:37.780452 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-27aece88-dcb9-4d04-bc41-16b9c228d6b1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:37.780452 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-27aece88-dcb9-4d04-bc41-16b9c228d6b1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:37.782966 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-1f8d0405-a83c-4eec-a7a4-ee46b2d463ba req-a42e247f-d0ad-4182-95a5-a69d861ca02b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17ee60a0-0ed0-4dd7-95e5-485558986d52", "tag": "79320d68-8728-4505-8872-70bd2eac8f26"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:25:37.785105 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-27aece88-dcb9-4d04-bc41-16b9c228d6b1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:37.785845 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-27aece88-dcb9-4d04-bc41-16b9c228d6b1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:37.786831 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-27aece88-dcb9-4d04-bc41-16b9c228d6b1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:37.787494 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-27aece88-dcb9-4d04-bc41-16b9c228d6b1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:37.795065 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-1f8d0405-a83c-4eec-a7a4-ee46b2d463ba req-a42e247f-d0ad-4182-95a5-a69d861ca02b service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:37.795994 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-1f8d0405-a83c-4eec-a7a4-ee46b2d463ba req-a42e247f-d0ad-4182-95a5-a69d861ca02b service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:37.819630 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-27aece88-dcb9-4d04-bc41-16b9c228d6b1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Going to try to terminate instance {{(pid=118162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:25:37.821346 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-1f8d0405-a83c-4eec-a7a4-ee46b2d463ba req-a42e247f-d0ad-4182-95a5-a69d861ca02b service nova] Creating event network-changed:79320d68-8728-4505-8872-70bd2eac8f26 for instance 17ee60a0-0ed0-4dd7-95e5-485558986d52 on hv-cinder-83754 Jun 16 18:25:37.830411 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-1f8d0405-a83c-4eec-a7a4-ee46b2d463ba req-a42e247f-d0ad-4182-95a5-a69d861ca02b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052007 Jun 16 18:25:37.831706 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 631/1259] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:25:38.350069 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-27aece88-dcb9-4d04-bc41-16b9c228d6b1 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "DELETE /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 204 len: 0 microversion: 2.1 time: 0.576937 Jun 16 18:25:38.353003 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 629/1260] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:25:37 2022] DELETE /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 18:25:38.365053 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ad7d495a-4cdc-49bb-a53d-7b870b3f7f92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:38.367087 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ad7d495a-4cdc-49bb-a53d-7b870b3f7f92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:38.378805 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ad7d495a-4cdc-49bb-a53d-7b870b3f7f92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:38.379655 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ad7d495a-4cdc-49bb-a53d-7b870b3f7f92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:38.386902 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ad7d495a-4cdc-49bb-a53d-7b870b3f7f92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:38.386902 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ad7d495a-4cdc-49bb-a53d-7b870b3f7f92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:38.538779 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-06dab2a2-cfa3-4e90-9181-dad16433c9b0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:38.541319 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-06dab2a2-cfa3-4e90-9181-dad16433c9b0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:38.549629 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06dab2a2-cfa3-4e90-9181-dad16433c9b0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:38.550372 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06dab2a2-cfa3-4e90-9181-dad16433c9b0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:38.551422 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06dab2a2-cfa3-4e90-9181-dad16433c9b0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:38.552095 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-06dab2a2-cfa3-4e90-9181-dad16433c9b0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:38.553341 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ad7d495a-4cdc-49bb-a53d-7b870b3f7f92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:38.563981 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ad7d495a-4cdc-49bb-a53d-7b870b3f7f92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1578 microversion: 2.1 time: 0.206365 Jun 16 18:25:38.564558 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 632/1261] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:38 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1578 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:25:38.729315 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-06dab2a2-cfa3-4e90-9181-dad16433c9b0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:38.737105 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-06dab2a2-cfa3-4e90-9181-dad16433c9b0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1553 microversion: 2.1 time: 0.202529 Jun 16 18:25:38.738035 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 630/1262] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:38 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:25:38.963082 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-375c08cc-2518-4bdc-a767-80a4dd77095d req-b1db4fdc-43b4-42e6-8d75-072a65422fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13282fd3-f81a-41ec-a714-aca0bbee3325", "name": "network-vif-deleted", "tag": "68704890-0b9c-4d29-b937-474b57bb62e2"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:25:38.972747 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-375c08cc-2518-4bdc-a767-80a4dd77095d req-b1db4fdc-43b4-42e6-8d75-072a65422fdd service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:38.973174 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-375c08cc-2518-4bdc-a767-80a4dd77095d req-b1db4fdc-43b4-42e6-8d75-072a65422fdd service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:38.986373 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-375c08cc-2518-4bdc-a767-80a4dd77095d req-b1db4fdc-43b4-42e6-8d75-072a65422fdd service nova] Creating event network-vif-deleted:68704890-0b9c-4d29-b937-474b57bb62e2 for instance 13282fd3-f81a-41ec-a714-aca0bbee3325 on hv-cinder-83754 Jun 16 18:25:38.991291 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-375c08cc-2518-4bdc-a767-80a4dd77095d req-b1db4fdc-43b4-42e6-8d75-072a65422fdd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031956 Jun 16 18:25:38.991945 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 633/1263] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:25:39.588991 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-08c24ee8-ca81-4ff5-b44b-508290b4cf93 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:39.590153 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-08c24ee8-ca81-4ff5-b44b-508290b4cf93 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:39.599604 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-08c24ee8-ca81-4ff5-b44b-508290b4cf93 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:39.600056 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-08c24ee8-ca81-4ff5-b44b-508290b4cf93 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:39.600829 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-08c24ee8-ca81-4ff5-b44b-508290b4cf93 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:39.601472 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-08c24ee8-ca81-4ff5-b44b-508290b4cf93 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:39.756265 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-c8ae64d0-aea1-426a-91f7-d2216ab24fe9 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:39.757716 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-c8ae64d0-aea1-426a-91f7-d2216ab24fe9 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:39.765189 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-08c24ee8-ca81-4ff5-b44b-508290b4cf93 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:39.765766 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c8ae64d0-aea1-426a-91f7-d2216ab24fe9 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:39.766220 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c8ae64d0-aea1-426a-91f7-d2216ab24fe9 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:39.767031 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c8ae64d0-aea1-426a-91f7-d2216ab24fe9 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:39.767467 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-c8ae64d0-aea1-426a-91f7-d2216ab24fe9 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:39.773787 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-08c24ee8-ca81-4ff5-b44b-508290b4cf93 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1578 microversion: 2.1 time: 0.188542 Jun 16 18:25:39.785150 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 631/1264] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:39 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1578 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:25:39.837544 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-c8ae64d0-aea1-426a-91f7-d2216ab24fe9 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:39.845244 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-c8ae64d0-aea1-426a-91f7-d2216ab24fe9 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1342 microversion: 2.1 time: 0.093240 Jun 16 18:25:39.845813 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 634/1265] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:39 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1342 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:25:40.792373 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-33ceefe2-96bd-486f-8329-588a5e57ab27 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:40.792976 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-33ceefe2-96bd-486f-8329-588a5e57ab27 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:40.799650 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33ceefe2-96bd-486f-8329-588a5e57ab27 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:40.800096 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33ceefe2-96bd-486f-8329-588a5e57ab27 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:40.801055 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33ceefe2-96bd-486f-8329-588a5e57ab27 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:40.801276 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-33ceefe2-96bd-486f-8329-588a5e57ab27 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:40.863742 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-549f3c27-88e0-4fdc-8854-d7585294285e tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:40.864442 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-549f3c27-88e0-4fdc-8854-d7585294285e tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:40.871646 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-549f3c27-88e0-4fdc-8854-d7585294285e tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:40.872182 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-549f3c27-88e0-4fdc-8854-d7585294285e tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:40.872964 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-549f3c27-88e0-4fdc-8854-d7585294285e tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:40.873404 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-549f3c27-88e0-4fdc-8854-d7585294285e tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:40.888265 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-33ceefe2-96bd-486f-8329-588a5e57ab27 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:40.896426 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-33ceefe2-96bd-486f-8329-588a5e57ab27 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1391 microversion: 2.1 time: 0.107759 Jun 16 18:25:40.897250 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 632/1266] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:40 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1391 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:25:40.917741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-549f3c27-88e0-4fdc-8854-d7585294285e tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:40.917741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-549f3c27-88e0-4fdc-8854-d7585294285e tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:40.917741 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-549f3c27-88e0-4fdc-8854-d7585294285e tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lazy-loading 'fault' on Instance uuid 13282fd3-f81a-41ec-a714-aca0bbee3325 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:25:40.926114 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-d199daca-7b1d-4ad8-ac63-a0f9aeb52459 req-f3966148-a029-49ae-b28a-c284b1117b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17ee60a0-0ed0-4dd7-95e5-485558986d52", "name": "network-vif-deleted", "tag": "79320d68-8728-4505-8872-70bd2eac8f26"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:25:40.936227 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-d199daca-7b1d-4ad8-ac63-a0f9aeb52459 req-f3966148-a029-49ae-b28a-c284b1117b95 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:40.936643 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-d199daca-7b1d-4ad8-ac63-a0f9aeb52459 req-f3966148-a029-49ae-b28a-c284b1117b95 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:40.950720 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-d199daca-7b1d-4ad8-ac63-a0f9aeb52459 req-f3966148-a029-49ae-b28a-c284b1117b95 service nova] Creating event network-vif-deleted:79320d68-8728-4505-8872-70bd2eac8f26 for instance 17ee60a0-0ed0-4dd7-95e5-485558986d52 on hv-cinder-83754 Jun 16 18:25:40.953306 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-549f3c27-88e0-4fdc-8854-d7585294285e tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3f73a99241e449bbee5e0a28878e80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd87cc7cb24ee0a0006089d4b13084', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:40.957765 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-d199daca-7b1d-4ad8-ac63-a0f9aeb52459 req-f3966148-a029-49ae-b28a-c284b1117b95 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034273 Jun 16 18:25:40.957765 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 633/1267] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:25:40.970228 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-549f3c27-88e0-4fdc-8854-d7585294285e tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 200 len: 1347 microversion: 2.1 time: 0.110849 Jun 16 18:25:40.970804 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 635/1268] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:40 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 1347 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:25:41.914801 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-f3428120-8471-4128-acbb-3765038ac34f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:41.915484 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-f3428120-8471-4128-acbb-3765038ac34f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:41.927808 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3428120-8471-4128-acbb-3765038ac34f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:41.928328 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3428120-8471-4128-acbb-3765038ac34f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:41.929112 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3428120-8471-4128-acbb-3765038ac34f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:41.929552 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3428120-8471-4128-acbb-3765038ac34f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:41.964804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3428120-8471-4128-acbb-3765038ac34f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:41.965251 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-f3428120-8471-4128-acbb-3765038ac34f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:41.965701 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.objects.instance [None req-f3428120-8471-4128-acbb-3765038ac34f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lazy-loading 'fault' on Instance uuid 17ee60a0-0ed0-4dd7-95e5-485558986d52 {{(pid=118162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:25:42.007786 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-f3428120-8471-4128-acbb-3765038ac34f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:42.010836 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6e6f9692-0eb6-44c3-be3c-bbbfbd53bec0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:42.011494 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-6e6f9692-0eb6-44c3-be3c-bbbfbd53bec0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] [instance: 13282fd3-f81a-41ec-a714-aca0bbee3325] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:42.016867 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-f3428120-8471-4128-acbb-3765038ac34f tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 200 len: 1229 microversion: 2.1 time: 0.106498 Jun 16 18:25:42.017652 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 634/1269] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:41 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:25:42.018042 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6e6f9692-0eb6-44c3-be3c-bbbfbd53bec0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:42.018493 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6e6f9692-0eb6-44c3-be3c-bbbfbd53bec0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:42.019273 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6e6f9692-0eb6-44c3-be3c-bbbfbd53bec0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:42.019742 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-6e6f9692-0eb6-44c3-be3c-bbbfbd53bec0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:42.034092 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-6e6f9692-0eb6-44c3-be3c-bbbfbd53bec0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] HTTP exception thrown: Instance 13282fd3-f81a-41ec-a714-aca0bbee3325 could not be found. Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6e6f9692-0eb6-44c3-be3c-bbbfbd53bec0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Request method failure captured: Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 HTTP/1.1 Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3TZPgE99esImYGle0X4swDwG61DW1-jIUJLTm4_DP_y9v8k4EzBUfBTb2sngJ3Q0NOxmBQMvpJK2AxAQ6axtS5BMntr4obiUPVGcDTwokc4KflWFze0-1q6GqHvHPVdVmzMl0Y-VSM2GwIeckV3R6wTxtcdozwQ-UwkdIU8mMKLhss Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: 60fd87cc7cb24ee0a0006089d4b13084 Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-TestMinimumBasicScenario-707270777 Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:25:42.035911 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:25:42.037751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_60fd87cc7cb24ee0a0006089d4b13084"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/60fd87cc7cb24ee0a0006089d4b13084"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/60fd87cc7cb24ee0a0006089d4b13084"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/60fd87cc7cb24ee0a0006089d4b13084"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:25:42.037751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-TestMinimumBasicScenario-707270777 Jun 16 18:25:42.037751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: 60fd87cc7cb24ee0a0006089d4b13084 Jun 16 18:25:42.037751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-TestMinimumBasicScenario-707270777 Jun 16 18:25:42.037751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-TestMinimumBasicScenario-707270777-project Jun 16 18:25:42.037751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:25:42.037751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:25:42.037751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: e3f73a99241e449bbee5e0a28878e80c Jun 16 18:25:42.037751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-TestMinimumBasicScenario-707270777-project Jun 16 18:25:42.037751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:25:42.037751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 13282fd3-f81a-41ec-a714-aca0bbee3325 could not be found. Jun 16 18:25:42.037751 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '13282fd3-f81a-41ec-a714-aca0bbee3325'} Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13282fd3-f81a-41ec-a714-aca0bbee3325 could not be found. Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:25:42.038636 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13282fd3-f81a-41ec-a714-aca0bbee3325 could not be found. Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13282fd3-f81a-41ec-a714-aca0bbee3325 could not be found. Jun 16 18:25:42.040225 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:42.041779 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-6e6f9692-0eb6-44c3-be3c-bbbfbd53bec0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Returning 404 to user: Instance 13282fd3-f81a-41ec-a714-aca0bbee3325 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:25:42.041779 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-6e6f9692-0eb6-44c3-be3c-bbbfbd53bec0 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325" status: 404 len: 111 microversion: 2.1 time: 0.030803 Jun 16 18:25:42.041779 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 636/1270] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:42 2022] GET /compute/v2.1/servers/13282fd3-f81a-41ec-a714-aca0bbee3325 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:25:42.046838 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-0ac14652-e20a-4335-bd69-191e30148356 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] Calling method '.version_select at 0x7f9c23d5b790>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:42.205019 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-0ac14652-e20a-4335-bd69-191e30148356 tempest-TestMinimumBasicScenario-707270777 tempest-TestMinimumBasicScenario-707270777-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-852534607" status: 202 len: 0 microversion: 2.1 time: 0.161850 Jun 16 18:25:42.205641 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 635/1271] 10.222.0.58 () {58 vars in 1268 bytes} [Thu Jun 16 18:25:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-852534607 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:25:43.035459 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2cc80cbe-83a2-4b64-a7ae-c80c7b9d7ccf tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:43.036077 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-2cc80cbe-83a2-4b64-a7ae-c80c7b9d7ccf tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 17ee60a0-0ed0-4dd7-95e5-485558986d52] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:43.043318 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2cc80cbe-83a2-4b64-a7ae-c80c7b9d7ccf tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:43.043809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2cc80cbe-83a2-4b64-a7ae-c80c7b9d7ccf tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:43.044647 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2cc80cbe-83a2-4b64-a7ae-c80c7b9d7ccf tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:43.045079 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-2cc80cbe-83a2-4b64-a7ae-c80c7b9d7ccf tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:43.059203 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-2cc80cbe-83a2-4b64-a7ae-c80c7b9d7ccf tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] HTTP exception thrown: Instance 17ee60a0-0ed0-4dd7-95e5-485558986d52 could not be found. Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2cc80cbe-83a2-4b64-a7ae-c80c7b9d7ccf tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Request method failure captured: Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 HTTP/1.1 Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3OBg-bnA_FUK4o7k_Ow1XSS_a3_up4kTPK_YsZRBCqtQyxw2rZiqPZ__iDqPLuraM8a6zBD5WZPJartqv-BMJ42rsHnNRSZY2G1YRYTTtg08O48A5zDArbhrboGUvF9bt3zFaumzgaGNuDh4TE28am-Hf0BRnkrcUht8FzQHai9qRI Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: bff5c01fd0ab4348b4704765f0195d50 Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-TestVolumeBootPattern-689768747 Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:25:43.060778 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:25:43.062697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:25:43.062697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-TestVolumeBootPattern-689768747 Jun 16 18:25:43.062697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: bff5c01fd0ab4348b4704765f0195d50 Jun 16 18:25:43.062697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-TestVolumeBootPattern-689768747 Jun 16 18:25:43.062697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-TestVolumeBootPattern-689768747-project Jun 16 18:25:43.062697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:25:43.062697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:25:43.062697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: f8cc86b384df4223a800838a3d386d3f Jun 16 18:25:43.062697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-TestVolumeBootPattern-689768747-project Jun 16 18:25:43.062697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:25:43.062697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance 17ee60a0-0ed0-4dd7-95e5-485558986d52 could not be found. Jun 16 18:25:43.062697 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': '17ee60a0-0ed0-4dd7-95e5-485558986d52'} Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ee60a0-0ed0-4dd7-95e5-485558986d52 could not be found. Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:25:43.063989 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ee60a0-0ed0-4dd7-95e5-485558986d52 could not be found. Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ee60a0-0ed0-4dd7-95e5-485558986d52 could not be found. Jun 16 18:25:43.065809 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:43.067285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-2cc80cbe-83a2-4b64-a7ae-c80c7b9d7ccf tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Returning 404 to user: Instance 17ee60a0-0ed0-4dd7-95e5-485558986d52 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:25:43.067285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-2cc80cbe-83a2-4b64-a7ae-c80c7b9d7ccf tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52" status: 404 len: 111 microversion: 2.1 time: 0.030841 Jun 16 18:25:43.067285 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 637/1272] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:43 2022] GET /compute/v2.1/servers/17ee60a0-0ed0-4dd7-95e5-485558986d52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:25:47.012534 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-18bd969e-bd86-4189-ade7-10468f85793c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:47.015934 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-18bd969e-bd86-4189-ade7-10468f85793c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:47.021054 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-18bd969e-bd86-4189-ade7-10468f85793c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:47.021487 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-18bd969e-bd86-4189-ade7-10468f85793c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:47.022259 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-18bd969e-bd86-4189-ade7-10468f85793c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:47.022694 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-18bd969e-bd86-4189-ade7-10468f85793c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:47.023082 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [req-cee2c152-381b-4252-8f19-cf2603faa6a6 req-24dbc3f7-2981-4b2d-8426-96d867d2a4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eaa76e3-7d8a-4702-bcca-4d870e086221", "tag": "b980ea2b-3e6e-4f83-93ba-c30098a1a716"}]} {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:25:47.035979 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-cee2c152-381b-4252-8f19-cf2603faa6a6 req-24dbc3f7-2981-4b2d-8426-96d867d2a4e2 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:47.037824 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [req-cee2c152-381b-4252-8f19-cf2603faa6a6 req-24dbc3f7-2981-4b2d-8426-96d867d2a4e2 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:47.053891 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-18bd969e-bd86-4189-ade7-10468f85793c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Going to try to terminate instance {{(pid=118162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:25:47.056670 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.compute.server_external_events [req-cee2c152-381b-4252-8f19-cf2603faa6a6 req-24dbc3f7-2981-4b2d-8426-96d867d2a4e2 service nova] Creating event network-changed:b980ea2b-3e6e-4f83-93ba-c30098a1a716 for instance 8eaa76e3-7d8a-4702-bcca-4d870e086221 on hv-cinder-83754 Jun 16 18:25:47.065983 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [req-cee2c152-381b-4252-8f19-cf2603faa6a6 req-24dbc3f7-2981-4b2d-8426-96d867d2a4e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048394 Jun 16 18:25:47.066943 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 638/1273] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:25:47.518540 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-18bd969e-bd86-4189-ade7-10468f85793c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 204 len: 0 microversion: 2.1 time: 0.508954 Jun 16 18:25:47.519241 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 636/1274] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:25:47 2022] DELETE /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:25:47.529387 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-ceedf7ae-cc8e-47ca-b78b-d00a893cb6c9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:47.530428 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-ceedf7ae-cc8e-47ca-b78b-d00a893cb6c9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:47.537954 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ceedf7ae-cc8e-47ca-b78b-d00a893cb6c9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:47.538750 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ceedf7ae-cc8e-47ca-b78b-d00a893cb6c9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:47.541193 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ceedf7ae-cc8e-47ca-b78b-d00a893cb6c9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:47.541858 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-ceedf7ae-cc8e-47ca-b78b-d00a893cb6c9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:47.750644 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-ceedf7ae-cc8e-47ca-b78b-d00a893cb6c9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:47.762736 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-ceedf7ae-cc8e-47ca-b78b-d00a893cb6c9 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1577 microversion: 2.1 time: 0.237591 Jun 16 18:25:47.764481 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 639/1275] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:47 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:25:48.783322 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-8d41a494-9087-4b14-9028-b95fb4137359 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:48.784106 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-8d41a494-9087-4b14-9028-b95fb4137359 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:48.792091 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8d41a494-9087-4b14-9028-b95fb4137359 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:48.792543 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8d41a494-9087-4b14-9028-b95fb4137359 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:48.793612 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8d41a494-9087-4b14-9028-b95fb4137359 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:48.794050 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-8d41a494-9087-4b14-9028-b95fb4137359 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:49.031047 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.policy [None req-8d41a494-9087-4b14-9028-b95fb4137359 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:49.039568 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-8d41a494-9087-4b14-9028-b95fb4137359 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1577 microversion: 2.1 time: 0.259742 Jun 16 18:25:49.040397 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 637/1276] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:48 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1577 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:25:50.057655 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8f0215a2-1df3-409b-bc16-b50eff939229 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:50.058360 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8f0215a2-1df3-409b-bc16-b50eff939229 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:50.065764 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8f0215a2-1df3-409b-bc16-b50eff939229 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:50.066320 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8f0215a2-1df3-409b-bc16-b50eff939229 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:50.067223 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8f0215a2-1df3-409b-bc16-b50eff939229 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:50.067726 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8f0215a2-1df3-409b-bc16-b50eff939229 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:50.359241 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [req-a7902e99-cd1a-47bd-8edd-88bf5e8933e5 req-0d93e7e6-7a5a-4ca0-966f-d8a04a8d9115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eaa76e3-7d8a-4702-bcca-4d870e086221", "name": "network-vif-deleted", "tag": "b980ea2b-3e6e-4f83-93ba-c30098a1a716"}]} {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:25:50.371295 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-a7902e99-cd1a-47bd-8edd-88bf5e8933e5 req-0d93e7e6-7a5a-4ca0-966f-d8a04a8d9115 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:50.372622 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [req-a7902e99-cd1a-47bd-8edd-88bf5e8933e5 req-0d93e7e6-7a5a-4ca0-966f-d8a04a8d9115 service nova] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:50.377718 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-8f0215a2-1df3-409b-bc16-b50eff939229 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:50.381889 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG dbcounter [-] [118162] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:25:50.387722 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8f0215a2-1df3-409b-bc16-b50eff939229 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1458 microversion: 2.1 time: 0.334833 Jun 16 18:25:50.389479 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 640/1277] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:50 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1458 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:25:50.391537 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.compute.server_external_events [req-a7902e99-cd1a-47bd-8edd-88bf5e8933e5 req-0d93e7e6-7a5a-4ca0-966f-d8a04a8d9115 service nova] Creating event network-vif-deleted:b980ea2b-3e6e-4f83-93ba-c30098a1a716 for instance 8eaa76e3-7d8a-4702-bcca-4d870e086221 on hv-cinder-83754 Jun 16 18:25:50.399282 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [req-a7902e99-cd1a-47bd-8edd-88bf5e8933e5 req-0d93e7e6-7a5a-4ca0-966f-d8a04a8d9115 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048401 Jun 16 18:25:50.400271 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 638/1278] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Jun 16 18:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:25:51.407829 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-0fa5ac52-8fcc-4b27-8dd4-ec98573ef99c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:51.409064 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-0fa5ac52-8fcc-4b27-8dd4-ec98573ef99c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:51.417943 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0fa5ac52-8fcc-4b27-8dd4-ec98573ef99c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:51.417943 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0fa5ac52-8fcc-4b27-8dd4-ec98573ef99c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:51.418665 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0fa5ac52-8fcc-4b27-8dd4-ec98573ef99c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:51.419104 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0fa5ac52-8fcc-4b27-8dd4-ec98573ef99c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:51.453640 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0fa5ac52-8fcc-4b27-8dd4-ec98573ef99c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:51.454102 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-0fa5ac52-8fcc-4b27-8dd4-ec98573ef99c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:51.454556 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.objects.instance [None req-0fa5ac52-8fcc-4b27-8dd4-ec98573ef99c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lazy-loading 'fault' on Instance uuid 8eaa76e3-7d8a-4702-bcca-4d870e086221 {{(pid=118161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:25:51.613033 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.policy [None req-0fa5ac52-8fcc-4b27-8dd4-ec98573ef99c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8cc86b384df4223a800838a3d386d3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bff5c01fd0ab4348b4704765f0195d50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:25:51.621575 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-0fa5ac52-8fcc-4b27-8dd4-ec98573ef99c tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 200 len: 1229 microversion: 2.1 time: 0.218976 Jun 16 18:25:51.622379 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 641/1279] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:51 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 1229 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:25:52.641421 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dfcfc866-f11e-48f5-afcc-f48f689bf08e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:52.642123 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-dfcfc866-f11e-48f5-afcc-f48f689bf08e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: 8eaa76e3-7d8a-4702-bcca-4d870e086221] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:52.656747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dfcfc866-f11e-48f5-afcc-f48f689bf08e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:52.656747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dfcfc866-f11e-48f5-afcc-f48f689bf08e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:52.656747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dfcfc866-f11e-48f5-afcc-f48f689bf08e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:52.656747 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-dfcfc866-f11e-48f5-afcc-f48f689bf08e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:52.667113 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-dfcfc866-f11e-48f5-afcc-f48f689bf08e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] HTTP exception thrown: Instance 8eaa76e3-7d8a-4702-bcca-4d870e086221 could not be found. Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dfcfc866-f11e-48f5-afcc-f48f689bf08e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Request method failure captured: Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 HTTP/1.1 Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3OBg-bnA_FUK4o7k_Ow1XSS_a3_up4kTPK_YsZRBCqtQyxw2rZiqPZ__iDqPLuraM8a6zBD5WZPJartqv-BMJ42rsHnNRSZY2G1YRYTTtg08O48A5zDArbhrboGUvF9bt3zFaumzgaGNuDh4TE28am-Hf0BRnkrcUht8FzQHai9qRI Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: bff5c01fd0ab4348b4704765f0195d50 Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-TestVolumeBootPattern-689768747 Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:25:52.668804 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:25:52.670615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:25:52.670615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-TestVolumeBootPattern-689768747 Jun 16 18:25:52.670615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: bff5c01fd0ab4348b4704765f0195d50 Jun 16 18:25:52.670615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-TestVolumeBootPattern-689768747 Jun 16 18:25:52.670615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-TestVolumeBootPattern-689768747-project Jun 16 18:25:52.670615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:25:52.670615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:25:52.670615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: f8cc86b384df4223a800838a3d386d3f Jun 16 18:25:52.670615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-TestVolumeBootPattern-689768747-project Jun 16 18:25:52.670615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:25:52.670615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance 8eaa76e3-7d8a-4702-bcca-4d870e086221 could not be found. Jun 16 18:25:52.670615 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': '8eaa76e3-7d8a-4702-bcca-4d870e086221'} Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eaa76e3-7d8a-4702-bcca-4d870e086221 could not be found. Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:25:52.671560 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eaa76e3-7d8a-4702-bcca-4d870e086221 could not be found. Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eaa76e3-7d8a-4702-bcca-4d870e086221 could not be found. Jun 16 18:25:52.673119 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:52.674545 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-dfcfc866-f11e-48f5-afcc-f48f689bf08e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Returning 404 to user: Instance 8eaa76e3-7d8a-4702-bcca-4d870e086221 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:25:52.674545 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-dfcfc866-f11e-48f5-afcc-f48f689bf08e tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221" status: 404 len: 111 microversion: 2.1 time: 0.033794 Jun 16 18:25:52.674545 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 639/1280] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:52 2022] GET /compute/v2.1/servers/8eaa76e3-7d8a-4702-bcca-4d870e086221 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:25:53.344529 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8f7d78ae-4a9e-42a1-b2a4-ece1ba04036a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:53.345135 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.compute.api [None req-8f7d78ae-4a9e-42a1-b2a4-ece1ba04036a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:53.353988 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8f7d78ae-4a9e-42a1-b2a4-ece1ba04036a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:53.355421 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8f7d78ae-4a9e-42a1-b2a4-ece1ba04036a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:53.357030 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8f7d78ae-4a9e-42a1-b2a4-ece1ba04036a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:53.358074 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG oslo_concurrency.lockutils [None req-8f7d78ae-4a9e-42a1-b2a4-ece1ba04036a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:53.376993 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.wsgi [None req-8f7d78ae-4a9e-42a1-b2a4-ece1ba04036a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] HTTP exception thrown: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8f7d78ae-4a9e-42a1-b2a4-ece1ba04036a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Request method failure captured: Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: request: DELETE /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 HTTP/1.1 Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept: application/json Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Accept-Encoding: identity Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Connection: close Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Length: 0 Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Content-Type: application/json Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Host: 10.222.0.58 Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Openstack-System-Scope: None Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: User-Agent: python-urllib3/1.26.9 Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Auth-Token: gAAAAABiq3OBg-bnA_FUK4o7k_Ow1XSS_a3_up4kTPK_YsZRBCqtQyxw2rZiqPZ__iDqPLuraM8a6zBD5WZPJartqv-BMJ42rsHnNRSZY2G1YRYTTtg08O48A5zDArbhrboGUvF9bt3zFaumzgaGNuDh4TE28am-Hf0BRnkrcUht8FzQHai9qRI Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Id: None Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Domain-Name: None Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Identity-Status: Confirmed Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Is-Admin-Project: True Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Id: default Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Domain-Name: Default Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Id: bff5c01fd0ab4348b4704765f0195d50 Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Project-Name: tempest-TestVolumeBootPattern-689768747 Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Role: reader,member Jun 16 18:25:53.378998 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Roles: reader,member Jun 16 18:25:53.386191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:25:53.386191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant: tempest-TestVolumeBootPattern-689768747 Jun 16 18:25:53.386191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Id: bff5c01fd0ab4348b4704765f0195d50 Jun 16 18:25:53.386191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-Tenant-Name: tempest-TestVolumeBootPattern-689768747 Jun 16 18:25:53.386191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User: tempest-TestVolumeBootPattern-689768747-project Jun 16 18:25:53.386191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Id: default Jun 16 18:25:53.386191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Domain-Name: Default Jun 16 18:25:53.386191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Id: f8cc86b384df4223a800838a3d386d3f Jun 16 18:25:53.386191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: X-User-Name: tempest-TestVolumeBootPattern-689768747-project Jun 16 18:25:53.386191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: method: > Jun 16 18:25:53.386191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: exception: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:25:53.386191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: action_args: {'id': 'ae1e37c8-4486-40de-8fed-db9178d0e6f8'} Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:25:53.387227 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:25:53.389019 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: ERROR nova.api.openstack.wsgi Jun 16 18:25:53.391094 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-8f7d78ae-4a9e-42a1-b2a4-ece1ba04036a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Returning 404 to user: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. {{(pid=118161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:25:53.391094 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-8f7d78ae-4a9e-42a1-b2a4-ece1ba04036a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 404 len: 111 microversion: 2.1 time: 0.044966 Jun 16 18:25:53.391094 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 642/1281] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Jun 16 18:25:53 2022] DELETE /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:25:53.394025 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2776cbd9-3d24-4ef1-80cd-bf129641ab92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '>' {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:53.394921 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.compute.api [None req-2776cbd9-3d24-4ef1-80cd-bf129641ab92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] [instance: ae1e37c8-4486-40de-8fed-db9178d0e6f8] Fetching instance by UUID {{(pid=118162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:25:53.403527 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2776cbd9-3d24-4ef1-80cd-bf129641ab92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:53.404293 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2776cbd9-3d24-4ef1-80cd-bf129641ab92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:53.405672 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2776cbd9-3d24-4ef1-80cd-bf129641ab92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:25:53.406302 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG oslo_concurrency.lockutils [None req-2776cbd9-3d24-4ef1-80cd-bf129641ab92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Lock "15bac147-d8da-4763-a2ba-05e16398e57c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:25:53.423928 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.wsgi [None req-2776cbd9-3d24-4ef1-80cd-bf129641ab92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] HTTP exception thrown: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2776cbd9-3d24-4ef1-80cd-bf129641ab92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Request method failure captured: Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: request: GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 HTTP/1.1 Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept: application/json Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Accept-Encoding: identity Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Connection: close Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Length: 0 Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Content-Type: application/json Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Host: 10.222.0.58 Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Openstack-System-Scope: None Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: User-Agent: python-urllib3/1.26.9 Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Auth-Token: gAAAAABiq3OBg-bnA_FUK4o7k_Ow1XSS_a3_up4kTPK_YsZRBCqtQyxw2rZiqPZ__iDqPLuraM8a6zBD5WZPJartqv-BMJ42rsHnNRSZY2G1YRYTTtg08O48A5zDArbhrboGUvF9bt3zFaumzgaGNuDh4TE28am-Hf0BRnkrcUht8FzQHai9qRI Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Id: None Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Domain-Name: None Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Identity-Status: Confirmed Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Is-Admin-Project: True Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Id: default Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Domain-Name: Default Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Id: bff5c01fd0ab4348b4704765f0195d50 Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Project-Name: tempest-TestVolumeBootPattern-689768747 Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Role: reader,member Jun 16 18:25:53.425491 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Roles: reader,member Jun 16 18:25:53.427340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bff5c01fd0ab4348b4704765f0195d50"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}] Jun 16 18:25:53.427340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant: tempest-TestVolumeBootPattern-689768747 Jun 16 18:25:53.427340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Id: bff5c01fd0ab4348b4704765f0195d50 Jun 16 18:25:53.427340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-Tenant-Name: tempest-TestVolumeBootPattern-689768747 Jun 16 18:25:53.427340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User: tempest-TestVolumeBootPattern-689768747-project Jun 16 18:25:53.427340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Id: default Jun 16 18:25:53.427340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Domain-Name: Default Jun 16 18:25:53.427340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Id: f8cc86b384df4223a800838a3d386d3f Jun 16 18:25:53.427340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: X-User-Name: tempest-TestVolumeBootPattern-689768747-project Jun 16 18:25:53.427340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: method: > Jun 16 18:25:53.427340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: exception: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:25:53.427340 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: action_args: {'id': 'ae1e37c8-4486-40de-8fed-db9178d0e6f8'} Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: {{(pid=118162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:25:53.431922 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. Jun 16 18:25:53.433780 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: ERROR nova.api.openstack.wsgi Jun 16 18:25:53.436475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: DEBUG nova.api.openstack.wsgi [None req-2776cbd9-3d24-4ef1-80cd-bf129641ab92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Returning 404 to user: Instance ae1e37c8-4486-40de-8fed-db9178d0e6f8 could not be found. {{(pid=118162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:25:53.436475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO nova.api.openstack.requestlog [None req-2776cbd9-3d24-4ef1-80cd-bf129641ab92 tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8" status: 404 len: 111 microversion: 2.1 time: 0.040668 Jun 16 18:25:53.436475 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: [pid: 118162|app: 0|req: 640/1282] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Jun 16 18:25:53 2022] GET /compute/v2.1/servers/ae1e37c8-4486-40de-8fed-db9178d0e6f8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:25:55.444789 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: DEBUG nova.api.openstack.wsgi [None req-bfafc2cd-5d8f-4e3f-911c-4f99e688440a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] Calling method '.version_select at 0x7f9c30403670>' {{(pid=118161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:25:55.861414 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO nova.api.openstack.requestlog [None req-bfafc2cd-5d8f-4e3f-911c-4f99e688440a tempest-TestVolumeBootPattern-689768747 tempest-TestVolumeBootPattern-689768747-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-629434427" status: 202 len: 0 microversion: 2.1 time: 0.420616 Jun 16 18:25:55.862071 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: [pid: 118161|app: 0|req: 643/1283] 10.222.0.58 () {58 vars in 1259 bytes} [Thu Jun 16 18:25:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-629434427 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:26:38.961003 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:26:38.961825 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Thu Jun 16 18:26:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:28:24.903212 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:28:24.903864 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Thu Jun 16 18:28:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:28:28.150463 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:28:28.151119 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Thu Jun 16 18:28:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:28:37.464461 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:28:37.465070 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Thu Jun 16 18:28:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:28:42.384184 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:28:42.384771 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Thu Jun 16 18:28:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:28:44.652943 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:28:44.653825 dv-cinder-837543-4-iscsi devstack@n-api.service[118162]: Thu Jun 16 18:28:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 18:29:58.971191 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 18:29:58.971961 dv-cinder-837543-4-iscsi devstack@n-api.service[118161]: Thu Jun 16 18:29:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!